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Abstract 

In this paper, bounds to the rate-equivocation region for the general 3-receiver broadcast channel (BC) with 
degraded message sets, are presented for confidential messages to be kept secret from one of the receivers. This 
model is more general than the 2-receiver BCs with confidential messages with an external wiretapper, and the 
recently studied 3-receiver degraded BCs with confidential messages, since in the model studied in this paper, 
the conditions on the receivers are general and the wiretapper receives the common message. Wyner's code 
partitioning combined with double-binning is used to show the achievable rate tuples. Error probability analysis 
and equivocation calculation are also provided. The secure coding scheme is sufficient to provide security for the 
3-receiver BC with 2 or 3 degraded message sets, for the scenarios: (i) 3 degraded message sets, where the first 
confidential message is sent to receivers 1 and 2 and the second confidential message is sent to receiver 1, (ii) 2 
degraded message sets, where one confidential message is sent to receiver 1, and (iii) 2 degraded message sets, 
where one confidential message is sent to receivers 1 and 2. The proof for the outer bound is shown for the cases 
where receiver 1 is more capable than the wiretap receiver 3, for the first two scenarios. Under the condition that 
both receivers 1 and 2 are less noisy than the wiretap receiver 3, the inner and outer bounds coincide, giving the 
rate-equivocation region for (iii). In addition, a new outer bound for the general 3-receiver BC with 3 degraded 
messages is obtained. 



I. Introduction 

Wireless communications channels today are vulnerable to eavesdropping or wiretapping due to the open nature 
of the channel, making the characterization of transmission rates for secure and reliable communication for the 
physical layer an important issue. In the wireless broadcast medium, the model of the broadcast channel (BC) 
with confidential messages, which was studied by Csiszar and Komer [1], is used to study simultaneously secure 
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and reliable communication. The model in [1] is a generalization of the characterization of the wiretap channel 
by Wyner [2]. In [1], a common message is sent to 2 receivers, while a confidential message is sent to one of 
the receivers and kept secret from the other. The secrecy level is determined by the equivocation rate, which is 
the entropy rate of the confidential message conditioned on the channel output at the eavesdropper or wiretapper. 
The secrecy capacity region is defined as the set of transmission rates where the legitimate receiver decodes its 
confidential message while keeping the message secret from the wiretapper. 

In more recent studies on the BC with confidential messages, Liu et al. [3] studied the scenario where there 
are 2 receivers and private messages are sent to each one and kept secret from the unintended receiver, while Xu 
et al. [4] looked at the same model in [3] but with a common message to both receivers. Then, Bagherikaram 
et al. [5] addressed the scenario where there are 2 receivers and one wiretapper, with confidential messages sent 
to the receivers. There have been recent studies where more than 2 receivers were considered. The authors in 
[6] and Ekrem and Ulukus in [7] independently studied the K-receiver BC with an external wiretapper. In [6], 
the K-receiver BC with confidential messages sent to each receiver was studied, while in [7], the same scenario 
was studied with the addition that each receiver also received a common message. Both used the degraded BC. 
In another work, an achievable inner bound for the iC-receiver BC with a common message sent to all receivers 
and a confidential message sent to each of the receivers to be kept secret from an external wiretapper was derived 
by Kobayashi et al. in [8] for general conditions on the receivers' and wiretapper's channels. Finally, Chia and 
El Gamal in [9] derived an achievable inner bound for the 3-receiver BC with a common message sent to all 
receivers and a private message sent to 2 of the receivers to be kept secret from the third. 

Recently in [10]-[12], Nair and El Gamal introduced the channel model of the 3-receiver BC with degraded 
message sets. In the general form of this model, a common message Wq is sent to all of the receivers, denoted 
by the set Maib and the private messages, Wj, Wi-i, . . . , Wi, are sent to subsets of receivers Mj C C • • • C 
Ml C Mall- This model best describes a multimedia broadcasting system, in which the common message Wo may 
represent the lowest quality transmission, and Wi the next higher quaUty transmission, and so on. In [10]-[12], 
three types of 3-receiver BCs with degraded message sets are studied: 

1) 3-receiver BC with 3 degraded message sets where Wq is sent to all three receivers, Wi is sent to receivers 
1 and 2, and a second private message W2 is sent to receiver 1 ; 

2) 3-receiver BC with 2 degraded message sets (Type 1) where the common message Wq is sent to all three 
receivers and a private message Wi is sent to the first receiver; 

3) 3-receiver BC with 2 degraded message sets (Type 2) where the common message Wq is sent to all three 
receivers and a private message Wi sent to receivers 1 and 2. 

While preparing this paper for submission, the authors became aware that Nair and El Gamal in [12] used a 
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different coding scheme for their achievabihty proof compared to their earlier work [10], with detailed proofs in 
[11]. The added ingredient is rate splitting. However, a coding scheme with and without rate splitting is shown 
to give the same rate region in [12]. Based on this, in this paper, we shall not use rate splitting but base our 
achievability proof on the one in [10, 11]. 

The objective of this paper is to study this model of the 3-receiver BC with degraded message sets of [10], 
[1 1] with secrecy constraints. In particular, we characterize the transmission rates for the three types of 3-receiver 
BCs with degraded message sets from the model mentioned above where receiver 3 is a wiretapper. We note that 
the insights which this model of the 3-receiver BC with degraded message sets might bring are due to it being 
a more general model than the 2- or 3-receiver degraded BC with secrecy constraints. We also note that Chia 
and El Gamal in [9] have also studied the 3-receiver BC with 2 degraded message sets (Type 2) with receiver 3 
being a wiretapper, but using a different coding scheme. 

For the 3-receiver BC with 3 degraded message sets and 2 degraded message sets (Type 1) without secrecy 
constraints, the inner capacity bound in [10], [11] is achievable by superposition coding, Marton's achievability 
technique [13] and indirect decoding, where the receivers decoding the common message only do so via satellite 
codewords instead of cloud centers. For the general 3-receiver BC with degraded message sets, an outer bound to 
the capacity region was given in [10, 11] only for the general 3-receiver BC with 2 degraded message sets (Types 
1 and 2). For the 3-receiver BC with 2 degraded message sets (Type 2), the inner and outer bounds coincide 
under the condition that first and second receivers are less noisy than the third receiver. 

In our earher work [14], we had studied the 3-receiver BC with 2 degraded message sets (Type 1), with the 
third receiver regarded as a wiretapper from which the private message is to be kept secret. In this paper, we 
consider the more general model of the 3-receiver BC with 3 degraded message sets where the third receiver 
is a wiretapper from which the private messages W\, Wi are to be kept secret. As the wiretapper in this case 
also decodes the common message, the 3-receiver BC with 3 degraded message sets with the third receiver a 
wiretapper describes a more general scenario than three types of scenarios: the 2-receiver BCs with an external 
wiretapper of [5], the 2-receiver BC with 3 degraded message sets and an external wiretapper, and the 3-receiver 
degraded BCs with an external wiretapper by the virtue of the general conditions on the receivers. 

In our secure coding scheme, we shall use a combination of the code partitioning of Wyner [2] and double- 
biiming of Liu et al. [3] to show the achievabihty of an inner bound to the rate-equivocation region for the 3- 
receiver BC with 3 degraded message sets. Error probability analysis and equivocation calculation for the private 
messages are provided. The proposed secure coding scheme is shown to be sufficient for providing security for 
both the 3-receiver BC with 3 degraded message sets and the 3-receiver BC with 2 degraded message sets (Type 
1). We obtain outer bounds to the rate-equivocation region for the 3-receiver BC with 3 degraded message sets 
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for the case where receiver 1 is more capable than the wiretap receiver 3, a weaker condition than the condition 
that receiver 3 is a degraded version of receiver 1 or the condition that receiver 1 is less noisy than the wiretap 
receiver 3 [15]. By removing the security constraints, we further obtain an outer bound to the capacity region 
for the general 3-receiver BC with 3 degraded message sets, which is not found in [10]- [12]. This is because 
the condition that receiver 1 is more capable than receiver 3 applies only to the case where we have secrecy 
constraints. Then, we show that the outer bounds to the rate-equivocation region for the 3-receiver BC with 3 
degraded message sets reduce to the outer bounds to the rate-equivocation region for the 3-receiver BC with 2 
degraded message sets (Type 1), if receiver 1 is more capable than the wiretap receiver 3. Finally, we show that, 
under the condition that the first and second receivers are less noisy than the third receiver, respectively (still 
a more general condition than degradedness [15]), the inner and outer bounds to the rate-equivocation region 
for the 3-receiver BC with 3 degraded message sets reduce to the region for the 3-receiver BC with 2 degraded 
message sets (Type 2). This rate-equivocation region we obtain is furthermore a special case of the variant of 
the 3-receiver BC with 2 degraded message sets (Type 2) studied in [9] with a different coding scheme. 

This paper is organized as follows. In Section 11, we describe the model for the 3-receiver BC with degraded 
message sets. In Section III, we state our main results, the bounds to the rate-equivocation region. In Section IV, 
we show achievabiUty of the inner bound to the rate-equivocation region using our secure coding scheme for the 
3-receiver BC with 3 degraded message sets and the 3-receiver BC with 2 degraded message sets (Type 1) and 
show error probability analysis and equivocation calculation for the private messages. We show that the coding 
scheme provides security for both types of channel. In Section V, we show the proof of the outer bounds for the 
three types of the 3-receiver BC with degraded message sets. Lastly, we give conclusions in Section VI. 

II. The 3-Receiver BC with Degraded Message Sets 

In this paper, we use the uppercase letter to denote a random variable (e.g., X) and the lowercase letter for its 
realization (e.g., x). The alphabet set of X is denoted by X so that x £ A^. We denote a sequence of n random 
variables by X = {Xi, . . . with its reahzation x = {xi,. . . ,Xn) £ A"" if Xi G A" for i = 1, 2, . . . ,n. 
Furthermore, we define the subsequences of X as X' = {Xi,X2, . . . ,Xi) and X' = {Xi, . . . , 

The discrete memoryless BC with 3 receivers has an input random sequence, X, and 3 output random sequences 
at the receivers, denoted respectively by Yi, Y2 and Y3, all of length n, with x G X"', yi G y^, y2 G 
ys G 3^3 • The conditional distribution for n uses of the channel is given by 

n 

p(yi,y2,y3|x) = Y[piyu,y2i,y3i\xi). (1) 

i=l 

A (2"-f^« , 2"-^! , 2"-^^ , n)-code for the 3-receiver BC with 3 degraded message sets, as depicted in Figure 1, 
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Fig. 1. The 3-receiver BC with 3 degraded message sets and confidential messages. 



consists of the following parameters: 

Wo = |l, • • • , 2"^" I , (common message set) 
Wi = |l, . . . , 2"-^' I , (private message set), 
>V2 = {l, . . . , 2'^^^ I , (private message set), 
/ : Wo X Wi X >V2 1-^ ;f", (encoding function), 
gi-.yi^WoxWix W2, (decoding function 1), 
52 : 3^2 '-^ Wo X Wi, (decoding function 2), 
93 ■ 3^3 '-^ Wo, (decoding function 3). 

In particular, we have 51 (Yi) = {W^'^\wl^\W2), 52 (Y2) = {W^ ,^1"^^), and 53 (Y3) = W^, where the 
notation "(•)" highlights that the decoded messages are estimates, with the error probability 

Pi") = Pr { (T^o^'^ , WP , , Wi^^ , H^f ) ,W2) {Wo,Wo,Wo,Wi,Wi,W2)} . (2) 

In this setup, ^3 is the wiretapper, and the secrecy level of the messages sent are as follows: 

1) For Wi sent to users 1 and 2, the secrecy level is defined by the equivocation rate ^H{Wi\Y3); 

2) For W2 sent to user 1, the secrecy level is defined by the equivocation rate ^H(W2\Y3); 

3) The combined message {Wi, W2) sent to user 1 has secrecy level defined by the equivocation rate ^H{Wi, W2IY3). 
In addition, a (2"^°,2"^i,n)-code for the 3-receiver BC with 2 degraded message sets (Type 1), as shown in 
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Fig. 2. The 3-receiver BC with 2 degraded message sets (Type 1) and confidential message. 

Figure 2, consists of the following parameters: 

Wo = |l, . . . , 2"^° I , (common message set) 

Wi = |l, . . . , 2"^^ I , (private message set), 

/ : Wo X Wi 1-^ (encoding function), 

51 : 1-^ Wo X Wi , (decoding function 1), 

92 ■ 3^2 Wo, (decoding function 2), 

53 : 3^3 Wo, (decoding function 3). 

We have gi{Yi) = {W^^\wl^^), 52 (Y2) = W^'^\ and 53 (Y3) = VF^j^^ with the error probability 

P^^^ =Fr{{wi'\w^^\w^^\wl'^) / (Tyo,W^o,VFo,VFi,)}. (3) 

With 13 the wiretapper, and the secrecy level of the message sent is y^H{Wi\Y^). 

Finally, a (2"-f^«, 2"^^ , n)-code for the 3-receiver BC with 2 degraded message sets (Type 2), as shown in 
Figure 3, consists of the parameters: 

Wo = |l, . . . , 2"^° I , (common message set) 
Wi = |l, . . . , 2"^^ I , (private message set), 
/ : Wo X Wi 1-^ ;f", (encoding function), 

51 : '-^ ^0 X Wi, (decoding function 1), 

52 : 3^2 ^0 X Wi, (decoding function 2), 

53 : 3^3 Wo, (decoding function 3). 
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Fig. 3. The 3-receiver BC with 2 degraded message sets (Type 2) and confidential message. 

We have 51 (Yi) = {W^^\wP), g2{Y2) = (W'o^^^f b> and 93 (Y3) = W^^\ and error probability 

Pi") = Vt[{W^^\w^^\w^^\w[^\w[^^) ^ {Wo, VFo, VFo, Wi.Wi)] . (4) 
The secrecy level of the message Wi sent to users 1 and 2 is defined by the equivocation rate ^H{Wi\Ys). 

III. Bounds to the Rate-Equivocation Region 

A. The 3-Receiver BC with 3 Degraded Message Sets 

For the 3-receiver BC with 3 degraded message sets, the rate tuple {Rq, Ri, Rie, R2, R2e) is said to be 
achievable if for any ??, ei, ei, £2, £1^2 > 0, there exists a sequence of (2"^°,2"^i,2"^%n)-codes for which 

(n) 

Pe < r] and the equivocation rates Rie and i?2e satisfy 

-H{Wi\Y3) > Rie - ei, or -H{Wi\Y3) > Rie - h, (5a) 
n n 

-H{W2\Ys)>R2e-e2, (5b) 
n 

-H{Wi, W2\Ys) > Rie + R2e " 61,2- (5c) 

n 

The two conditions on Wi arise because the equivocation rate depends on which destination Wi is sent to, 
as can be seen below in (6d). Recall from the model of the 3-receiver BC with 3 degraded message sets that 
Wi is sent to both Yi and Y2. The first equivocation rate in (5a) corresponds to Wi being sent to receiver Y2 
and the second equivocation rate in (5a) corresponds to Wi being sent to receiver Yi. The rate-equivocation 
region for the 3-receiver BC with 3 degraded message sets is the closure of the set of all rate-tuples such that 
{Rq, Ri, Rie, R2, R2e) is achievable. Our analysis does not include the case of perfect secrecy (i.e., the rate 
region with Rie = Ri and i?2e = ^2)- The following theorems summarize the main results of this paper. 



Theorem 1: An inner bound to the rate-equivocation region for the 3-receiver BC with 3 degraded message 
sets is the closure of all rate-tuples {Rq, Ri, Rie, R2, R2e) satisfying 

Rie <Ri, (6a) 

R2e <R2, (6b) 

Ro <I{U3;Y3), (6c) 

Rie < min {l{U2;Y2\Ui) - R[,I{X; Yi\Us) - R[ - R'^} , (6d) 

R2e<I{X;Yi\U2)-R'2, (6e) 

Rie + R2e <I{X; Yi\Ui) - R[ - R'2, (6f) 

Ro + Ri <mm{I{U2;Y2),I{Us;Ys) + I{U2;Y2\Ui) - I{U2;U3\Ui)} (6g) 

2R0 + R1 <I{U3;Y3) + I{U2;Y2) - I{U2;U3\Ui), (6h) 

Ro + R2 <I{U3; Y3) + I{X- Yi\U2, Us), (6i) 

Ro + Ri + R2< min {/([/g; ^3) + ^X; Yi\U3),IiX- Yi), 

I{Us; Ys) + /(C/2; I2IC/1) - I{U2; U3\Ui) + I{X; Yi\U2, U3)} , (6j) 

2Ro + R1 + R2 <I{U3; Ys) + /(C/s; Y2) - /(C/s; C/sl^/i) + I{X; Yi\U2, U3), (6k) 

Ro + 2Ri + R2 <I{U3; Y3) + /(C/2; I2IC/1) - /(C/2; C/3IC/1) + /(X; F1IC/3), (61) 

2/?o + 2Ri + i?2 </(C/3; I3) + /(C^2; ^"2) - /(C/2; C/3IC/1) + /(X; FilC/a), (6m) 

in which R[ = /(C/2; ^|C/i) and R2 = I{X; Ys\U2) are defined over the the probabiUty density function (p.d.f.) 

p{ui,U2,U3,x) = p{ui)p{u2\ui)p{x,U3\u2) = p{ui)p{u3\ui)p{x, U2\u3) = p{ui)p{u2, U3\ui)p{x\u2, U3) , (7) 

which is induced by the coding scheme. In addition, we require that the condition 

I{X;Y3\U2) < I{X;Yi\U2,U3) (8) 
is met. From the p.d.f. (7), the auxihary random variables Ui, U2 and U3 satisfy the Markov chain conditions 

Ui^U2^ (C/3, X) ^ (Yi, ^2, 13), (9a) 
C/i ^ C/3 ^ (C/2, X) ^ {Yi,Y2,Y3), (9b) 
Ui ^ (C/2, c/3) ^ X ^ {Yi,Y2,Y3). (9c) 

Proof: The proof of achievabiUty is based on that for the 3-receiver BC with 3 degraded message sets in 
[10], [11] which uses Marton's achievabiUty scheme [13] combined with superposition coding and is given in 
Section IV-A with the equivocation calculation (bounds for R^i , Re2) to be presented in Section IV-C. ■ 
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Since our achievability scheme is based upon that of [10], [11], it is natural that the inner bound is the same 
as that of [10], [11], but with the addition of the equivocation rates. In fact it will be the same as [12], with the 
addition of the equivocation rates. As a check, setting Yi = in (6d)-(6f), Ri^ < 0, i?2e ^ and Rie + R2e ^ 0, 
so no secrecy rate is possible. Thus the equivocation rates (6d)-(6f) are achievable. 

Theorem 2: An outer bound to the rate-equivocation region for the 3-receiver BC with 3 degraded message 
sets, where Yi is more capable than I3, is the closure of all rate-tuples (i?o, Ri, Ru, R2,R2e) that satisfies 



Rie <Ri, (10a) 

R2e <R2, (10b) 

Ro <mm{I{Ur,Yi),I{Us;Y3) - I{Us;Y^\Ui)} , (10c) 

Rie < min {I{U2 ■,Y2\Ui) - I{U2;Y3\Ui),I{X-Yi\U3) - I{X;Y3\Ui)} , (lOd) 

R2e <I{X;Yi\U2) - I{X;Ys\U2), (lOe) 

Rie + R2e <I{X;Yi\Ui) - I{X;Ys\Ui), (lOf) 
Ro + Ri< min {/(C/s; Y^), I{U2; ^2), /(C/i; n) + /(^^a; Y2\Ui), 

liUs; I3) + I{U2; Yi\Ui), I{U3;Ys) + I{U2; I2IC/1)} , (lOg) 

Ro + R2< min {/(f/i; Fi) + I(X; Yi\U2, U3), liW^Y^) + I{X- Yi\U2, C/3)} , (lOh) 
Ro + Ri + R2< mm{I{X- Yi),I{U3; Y3) + I{X- Yips), 

I{Ur,Yi) + I{U2;Y2\Ui) + I{X- Yi I C/2 , C/3) , 

I{U3;Y3)+I{U2;Y2\Ui) + I{X-Yi\U2,U3), /(C/2; ^2) + /(X; yi|C/2, C/3)} . (lOi) 

Proof: The proof for this outer bound is given in Section V-A. ■ 



We see that the equivocation rates for {Rie, R2e) in the inner and outer bounds in Theorems 1 and 2 match. Note 
that the equivocation rate for i?ie received at Yi is reduced by Ai = /(C/2; I3IC/1) + Y3IC/2) = I{X; Y^lUi). 
In Ai, the first term is needed to protect the codewords generated by Marlon's achievability scheme, and the 
second term protects codewords generated by superposition coding. While it is only required to protect the 
codewords generated by Marlon's achievability scheme for the general 2-receiver BC in [5], our secure scheme 
(to be presented in Section IV) does this, as well as protects the additional codewords generated by superposition 
coding. Hence, our secure scheme results in a loss for Rie (compared to Ri) that may be larger than expected. 

It is also noted that by removing the secrecy constraints from the outer bound to the rate-equivocation region 
for the 3-receiver BC with 3 degraded message sets, we can obtain a new outer bound to the capacity region of 
the general 3-receiver BC with 3 degraded message sets without secrecy. We see this by setting Rie = and 
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i?2e = in Theorem 2 above. Since the restriction that receiver Yi is more capable than receiver is only 
applicable when deriving i?ie and i?2e as will be shown in Section V-A, removing the secrecy constraints will 
give us the outer bound to the capacity region of the general 3-receiver BC with 3 degraded message sets. 

Theorem 3: An outer bound to the capacity region for the general 3-receiver BC with 3 degraded message 
sets is the closure of all rate-tuples {Ro,Ri,R2) satisfying 

Ro <mm{I{Ui;Yi),I{U3;Y3) - I{U3;Yi\Ui)} , (11a) 

Ro + Ri< min {/(t/2; Y^), I{U2;Y2), I{Ui;Y^) + I{U2; Y2\Ui), 

/(C/3; Y3) + 7(C/2; yi|C/i), /(C/3; 1^3) + I{U2;Y2\Ui)} , (lib) 

Ro + R2< min{/(C/i; Yi) + I{X- Yi\U2, U3), /(C/3; ^3) + I{X; Y1IC/2, C/3)} , (He) 

Ro + Ri + R2< min {I(X; Fi), I(C/3; 1^3) + I{X; Yipa), I{Ur,Yi) + /(C/2; Y2\Ui) + I{X; Yi\U2, C/3), 

7(C/3;y3) + /(C/2;i^2|C/i) + Yi|C/2,C/3), /(C/2; ^2) + /(^; il|C/2, C/3)} • (Hd) 

Proof: As described above. ■ 

B. The 3-Receiver BC with 2 Degraded Message Sets 

The 3-receiver BC with 3 degraded message sets with secrecy constraints can be specialized to 2 classes of a 
3-receiver BC with 2 degraded message sets with secrecy constraints: 

1) Type 1: A 3-receiver BC where (Wo, VFi) is sent to receiver Yi and Wq is sent to receivers Y2 and Y3, 
where Wi is to be kept secret from receiver 13; 

2) Type 2: A 3-receiver BC where (Wq, Wi) is sent to receivers Yi and Y2 and Wq is sent to receiver Y3, 
where Wi is to be kept secret from receiver 13. 

We note that the inner and outer bounds do not match for the first case, but match for the second case under the 
condition that both receivers Yi and Y2 are less noisy than receiver Y3. 

We have studied the Type 1 channel in [14]. In this paper, we shall briefly review the achievability scheme for 
secrecy constraints to see the differences from the 3 degraded message sets case, and show that the outer bound 
for the 3 degraded message sets case can be reduced to the outer bound for this Type 1 channel. 

For the Type 2 channel, we shall show that the bounds on the rate-equivocation region can be specialized from 
the 3 degraded message sets case. We also note that the Type 2 channel is a special case of the iimer bound to 
the rate-equivocation region for a 3-receiver BC with 2 degraded message sets studied in Chia and El Gamal [9] 
using a different coding scheme. In [9], the message reception and secrecy conditions are the same as the Type 
2 channel. Thus, both our bounds and that of [9] will reduce to the Type 2 channel. Also, our outer bounds will 
reduce to the Type 2 channel under the conditions that both receivers Yi and Y2 are less noisy than receiver Y3. 
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We state the inner and outer bounds to the rate-equivocation region for the Type 1 channel in Corollaries 1 
and 2, and the rate-equivocation region for the Type 2 channel in Corollary 3. 

Corollary 1: An inner bound to the rate-equivocation region for the 3-receiver BC with 2 degraded message 



sets (Type 1) is the closure of all rate-tuples {Ro,Ri,Rie) satisfying 

Rie <Ri (12a) 

Ro<mm{I{U2;Y2),I{U3;Ys)} (12b) 

Ru <mm {I{X;Yi\Ui) - A2, 1{X;Yi\U2) + I{X;Yi\Us) - I{X;Y3\U2) - A2}, (12c) 

2i?o </(C/2; I2) + HU3; Y^) - I{U2; U^pi) (12d) 

Ro + Ri< min {I{X; Fi), /(C/s; Fs) + I{X; Yi\U2), I{U3; I3) + I{X; 11 IC/3)}, (12e) 

2R0 + R1 <I{U2;Y2)+I{Us;Ys)-I{U2;U3\Ui)+I{X;Yi\U2,Us), (12f) 

2i?o + 2i?i <I{U2;Y2) + I{X;Y^\U2) + I{U3;Ys) + I{X;Yi\U3) - I{U2;U3\Ui), (12g) 



under the same Markov chain conditions (9) for the auxihary random variables, where A2 = I{U2;Y3\Ui) + 
I{X;Y3\U2), and the conditions 

' I{X;Y3\U2) < I{X;Yi\U2,U3), 

(13) 

I{X;Y3\U2) < IiX;Yi\U2), 

are satisfied. 

Proof: See Section IV-B for the achievabiUty proof, and [14] for the equivocation calculation. ■ 
We see that A2 in Corollary 2 may be expressed as 

A2 ^ I{U2;Y3\Ui) + I{X;Y3\U2) = I{X;Y3\Ui), (14) 

which is > I{X; lal^/a). Thus, as a check, when Yi = Y3 in (12c), Rie < 0, so no secrecy rate is possible and 
therefore the equivocation rate (12c) is achievable. Also, when compared to the equivocation rates on Rie for the 
3 degraded message sets channel in (6d), a smaller rate is achievable for Wi sent to Yl. Then, by the virtue of 
sending W2 to Yl, the coding scheme of [10], [11] is able to give a higher equivocation rate for Wi sent to Yi. 
It appears that by sending more messages to receiver Yi, then the achievable equivocation rates can be increased. 

The lower achievable rate for Wi sent to Yi for the 2 degraded message sets (Type 1) channel is due to the 
fact that the achievable coding scheme protects all the codewords generated by superposition coding. We note 
that the coding scheme of [10, 11] generates codewords giving rise to the rates Ri < I{X; Yi\U2) + I{X; Yi|?73) 
and Ri < I{X; Yi\Ui). From the fact that when Yi = Y3 in (12c), Rie < for both choices of Rie, so implying 
the equivocation rates (12c) are achievable, we see that our proposed secure scheme is able to protect all the 
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codewords generated by superposition coding, but with a smaller achievable equivocation rate for Wi sent to Yi 
compared to Rie (with Wi sent to Yi) for the 3 degraded message sets channel. 

The outer bound for the Type 1 3-receiver 2 degraded message sets BC is stated as follows. 

Corollary 2: An outer bound to the rate-equivocation region for the 3-receiver BC with 2 degraded message 
sets (Type 1), where Yi is more capable than Y^, is the closure of all rate-tuples (i?o, -Ri, -Rie) satisfying 

Rie <Ri, (15a) 

i?o < min {/([/i ; ) , /(C/2 ; ^2) - /(^72 ; n I t/i ) , /([/s ; Fa) - ; nl t/i ) } (15b) 

Rie <I{X;Yi\Ui) - I{X;Ys\Ui), (15c) 

Ro + Ri< min {/(X; Yi), I{U2;Y2) + I{X- Yi\U2),I{U^; I3) + I{X; Yi\U^)]. (15d) 

Proof: See Section V-B. ■ 
We state the rate-equivocation region for the Type 2 3-receiver 2 degraded message sets BC below. 
Corollary 3: The secrecy capacity region for the 3-receiver BC with 2 degraded message sets (Type 2) for the 
case where YI and Y2 are both less noisy than 13 is the closure of all rate-tuples {Ro, Ri,Rie) satisfying 

Ru <Ri, (16a) 

Ro<I{U;Y3), (16b) 

Rie < min {I{X; Yi\U) - /(X; Ys\U), I{X; Y2\U) - I{X; Ys\U)} , (16c) 

Ro + Ri <min{I{X;Yi),I{X-Y2)}, (16d) 

over the p.d.f. p(u,x) = p(u)p(x\u). 

Proof: In this channel class, the inner and outer bounds match. The proof of achievability follows by using 
code partitioning for security, as in [1,2], where it can be seen that the codeword X is protected by the partition 
of I{X;Ys\U). The rate-equivocation region is achievable by setting R2 = 0, R2e = 0, U2 = X, U3 = Ui = U 
in Theorems 1 and 2 and using the conditions that Yi and Y2 are less noisy than 13. Therefore, we have the 
conditions I{U; F3) < I{U; Yi) and I{U; Y3) < I{U; Y2). See Section V-C for the converse proof. ■ 
It is worth emphasizing here that this channel class is more general than the special case of the 3-receiver 
BC with 2 degraded message sets (Type 1) under the condition that Yi is less noisy than Y3 in [14], since Y2 
receives W\ here but this is not the case in [14]. 
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Fig. 4. Coding for 3-receiver BC with degraded message sets and confidential messages. 



IV. Inner Bound for the 3-Receiver BC with 3 Degraded Message Sets 
A. Proof of Achievability for 3-Receiver BC with 3 Degraded Message Sets 

Our achievability proof for the 3-receiver BC with 3 degraded message sets is an alternative version of the one 
in [11, Appendix III]. We use Wyner's code partitioning [2] with the double-binning scheme of [3] to provide 
secrecy, together with the coding scheme for the 3-receiver BC with 3 degraded message sets in [10, 11]. 

The scheme of [10], [11] represents Wq by Ui, then breaks W2 into 2 parts. The first part is combined with 
Ui by superposition coding to generate U^- The message Wi is combined with Ui by superposition coding to 
generate C/2. U2 and U3 are partitioned into bins and the product bin containing the joint typical pair (achievable 
by Marton's coding scheme) is combined with the second part of W2 by superposition coding to obtain X. 

At the receivers, Yi decodes Ui, U2, U^, and X to recover the messages Wq, Wi and W2, while Y2 decodes 
Ui and U2 to recover messages Wq and Wi and Y3 decodes Ui indirectly using C/3 to recover Wq. In our 
secure scheme, the codewords U2 and X are, respectively, protected from receiver (i.e., the wiretapper) by a 
one-sided double-binning and code partitioning. This is depicted in Figure 4. 



14 



Suppose that we have the p.d.f. in (7) which induces the Markov chain conditions Ui ^ U2 ^ {U3,X), 
Ui ^ Us ^ {U2, X) and Ui {U2, f/3) X. The following describes the encoding and decoding processes. 

Codebook generation: Let ^1 = + R'l + RI, p3 = P3 + Pj, Pi = Pu + P{, and R2e = P3 + Pie- Define, 
for security, 

Pi ^ I{X; Y3\U2) - Si, and R[ ^ I{U2; Y^pi) - di, (17) 

where Si > and is small for n sufficiently large. 

First of all, generate 2"^ sequences Ui(u;o), for wq G Wq, randomly and uniformly from the set of typical 
Ui sequences. For each 'Ui{wo), generate 2"*^^ sequences U2{wo,q2) randomly and uniformly from the set of 
conditionally typical U2 sequences, and also 2"'^^ sequences JJ^iwo, q^) randomly and uniformly from the set of 
conditionally typical U3 sequences. Next, randomly partition the sequences, \J2{wo, q2), into 2"^^ equally-sized 
bins, and the sequences, \J3{wo, 53), into 2"^^ equally-sized bins. The U2 codewords undergo a double partition: 
the first into 2"^i« bins, and the second further partitions them into 2"^'i bins, each of size 2"^* . On the other 
hand, the U3 codewords undergo a single partition into 2"^=* bins, each of size 2"^3 . 

Each product bin {wi,w'i,p3) contains the joint typical pair (JJ2{wo,wi,w'i,Wi),lJ3{wo,P3,pl)) for wi G 
{1, . . . , 2"-^!-}, w[ G {1, . . . , 2^'i}, wle{l,..., 2"'f^^}, p3 G {1, . . . , 2"-P3}, and ^ € {1, ... , 2''^^} with high 
probability under the conditions [16] 

Pie + R'l + Pi < Q2 ^ Pie + R'l ^ Q2i 
P3+p1<Q3^P3<Q3, 

(18) 

p1 + p] >/(f/2;;73|C/i), 

Pie + P'l + P3 < Q2 + Q3 - IiU2; U3\Ui). 

Now let us rewrite the joint typical pair as {u2{wo, wi,w'i), U3{wo,p3)). For each such pair corresponding to the 
product bin {wi,w[,p3), generate 2"^^ sequences of codewords X.{wo, wi,w[,p3,pi,p[), foipi G {1, . . . , 2"^i«} 
and p'l G {1, . . . , 2"^i'}, uniformly and randomly over the set of conditionally typical X sequences. The 2"^^ 
codewords are partitioned into 2"-^^" subcodes with 2"^i' codewords within the subcodes. 

Encoding: To send {wo,wi,W2), express W2 by (^1,^3) and send the codeword K.{'Wo,wi,w'i,p3,pi,p'i). 

Decoding: Use T^{Pz) to denote the set of jointly strong typical n-sequence with respect to the p.d.f. p{z). 
Without loss of generality, assume that {wq, wi,p3,pi) = (1, 1, 1, 1) is sent and w[ and p[ can be arbitrary. The 
receivers decode as follows: 

1) Receiver 1 uses joint typical decoding of {ui,U2,U3,x, yi} to find the indices {wo,wi,p3,pi). 

2) Receiver 2 uses indirect decoding of U2 [10] to find the index wq. Once this is known, ui is also found. 
Then, receiver 2 uses joint typical decoding of {ui, U2, 72} to find wi. 
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3) Receiver 3 uses indirect decoding of U3 to find the index wq. 

At receiver 1, the decoder seeks the indices {wo,wi,p3,pi) so that 

{ui{wQ),U2{wo,wi,w[),U3{p3),yi{wo,wi,w[,p3,pi,p[),yi) e T^{Pu^u,UsXyJ- (19) 

If there is none or more than one possible codeword, an error is declared. The possible error events are as follows: 

a) El : {wo,wi,w[,p3,pi,p[) = {l,l,w'i,l,l,p'i) but ui, U2, U3, x are not jointly typical with y. By the 
properties of strong typical sequences [17], Pr{Ei} < e', where e' ^ for large n. 

b) E2 : luo 7^ 1 and arbitrary wi, ps, pi, with ui, U2, U3, x jointly typical with yi. Then, we have 

Pr{E2} < {i'Vi{wo),'U2iwo,wi,w[),lJs{p3),X{wo,wi,w[,p3,pi,p'^),yi) &T^{Pu^U2U3XyJ} 

™l.P3>Pl.<"i'P'i 

2r>'{Ro+Rie+R'i+Pie+Pl+P3)2-"'iHUi,U2,U3,X;Yi)-2S) ^20) 

where (5 — >^ as e — >^ for n sufficiently large. For Pr{E2} < e', we require 

Ro + Rie + R'l + Pie + Pi + P3< I{Ui,U2, U^^X; Yi) = I{X; Yi) (21) 
since I{Ui,U2, Us; Yi\X) = by the Markov chain condition 

Ui^{U2,U3)^X ^Yi. (22) 

c) E3 : f^o = 1, u^i 7^ 1 and arbitrary ps, p\, with ui, U2, U3, x jointly typical with yi. Then, we have 
Pr{E3} < Pr{(ui(l),U2(l,t/;i,^),U3(p3),X(l,u;i,H,p3,Pi,pi),yi) GTTCPc/.c/.c/sXyJ} 

2n{Rie+n'^+Pic+Pi+P3)2-'n{I{U2,U3,X;Yi\Ui)-25) ^23) 

For Pr{E3} < e', we require 

i?ie + + Pie + P[ + Ps< I{U2, U3, X; Yi |C/i) 

= /(X;yi|[/i)+/([/2,t/3;Fi|X,[/i) =/(X;yi|[/i), (24) 

where the second line is due to Ui — > {U2, U3) X —>■ Yi. 

d) E4 : u;o = 1, u;i = l,p3 7^ 1 and arbitrary pi, with ui, U2, U3, x jointly typical with yi. Then, we have 



Pr{E4} < Y Pr{(ui(l),U2(l,l,^),U3(p3),X(l,l,«;i,p3,Pi,pi),yi) GT,"(Pc/,[/,[/3xyJ} 

^ 2niPi,+Pi+P3)2-niI(U3,X;Yi\Ui,U2)-2S) ^25) 
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For Pr{E4} < e', we require 

Pie + Pi + P3< I{U3, X; Fi U2) = I{X; Yi\Ui, U2) + /(^/g; Fi|C/i, C/2, X) 
I{X-Yi\U2) + I{U3;Yi\U2,X) 

I{X-Yi\U2), (26) 

where the first term in (a) is due io U\ ^ U2 ^ X ^ Yi and the second term is due to U\ — > {U2-, U3) X ^ 
Yi, and (b) is due to Us {U2,X) Yi. 

e) -.Wo = 1, f^i = 1,P3 = 7^ 1 with ui, U2, U3, x jointly typical with yi. Then, we have 

Pr{E5} < Pr{(ui(l),U2(l,l,t/;i),U3(l),X(l,l,^,l,pi,pi),yi) Grf(P[/,[/,[/3xyJ} 

<- 2n{Pi,+Pi)2-n{I{X;Yi\U^,U^,Us)-2S)_ ^27) 

For Pr{E5} < e', we require 

Pie + Pi < I{X;Yi\UuU2,U3) = I{X;Yi\U2,U3) (28) 

where the equality is due to Ui iU2,Us) X ^ Yi. 

e) Eq : wq = 1, wi ^ l,p3 = 1 and pi arbitrary with ui, U2, Ua, x jointly typical with yi. Then, we have 

Pr{E6} < YI PHiM^)^^2{l,wi,w[),U3{l),X{hwi,w[,l,pi,p[),yi)eT^{Pu,UMYj} 

^ 2n{Rle+R'^+Ple+Pl)2-n{IiU2,X■,Y^\U^,U3)-25) ^29) 

For PrjEg} < e', we require 

Rie + R[ + Pie + Pi <I{U2,X-Yi\Ui,U3) = /(X; Yi\Ui,U3) + /(C/2 ; | C/i , C/3, X) 

I{X; Yi\U3) + I{U2; Yi\U3, X) 
'^^ I{X;Yi\U3), (30) 

where the first term of (a) is due to Ui ^ U3 ^ X —>■ Yi and the second term of (a) and (b) are due to 
Ui^U2^ {U3,X) Yi. Consequently, under the conditions (21), (24), (26), (28), (30) listed above, the error 
probability at receiver 1 is less than J^f^-^ Pr{Ei} < 6e'. 

Now, assume that {wq, §2) = (1)1) is sent to receiver 2. At receiver 2, the decoder first finds wo by indirect 
decoding, then finds wi by joint typical decoding. The error events at receiver 2 may be divided into: 

a) E'^ : (u'o, 52) = (1, 1) but U2 is not jointly typical with y2 (indirect decoding). In this case, by the properties 
of strong typical sequences, we have PrjE'j^} < e'. 



17 



b) E2 : u;o 7^ h 92 arbitrary and U2 is jointly typical with y2 (indirect decoding). This is the same as receiver 
2 trying to estimate wq such that {u2{wo, ^2), ya) G Tl^{Pu2Y2) for any ^2 G {1, • • • , 2'^^'^}. We have 

Pr{E^} < EM(U2K,92),y2) G 7r(J'c/.yJ} < 2-(«°+Q^)2-(^(^=;^^)-25). (31) 
Then, for PrjEg} < e', we need 

Ro + Q2<I{U2\Y2). (32) 

c) Eg : u;o = 1> 92 7^ 1> and Ui, U2 are jointly typical with y2. Then, we have 

Pr{E^} < ^Pr{(ui(l),U2(l,92),y2) G T^iPu.u.Y.)} < 2«Q=2-"(^(^-^=l^^)-2'5). (33) 
92 

Then, for Pr{E2} < e', we need 

Q2<I{U2\Y2\Ui). (34) 

Thus, under the conditions (32) and (34), the error probabihty at receiver 2 is less than Y^^=i Pr{E^} < 3e'. 

At receiver 3, indirect decoding is used, so that the decoder estimates wq such that (u3('u;o, 93), ya) G T^{Pu3Y3) 
for any ^3 G {1, . . . , 2"'^='}. Assuming that (u/q, 93) = (1, 1) is sent, we require 

i?o + Q3</(C/3;l3), (35) 

for the error probability at receiver 3 to be small for n sufficiently large. 
In addition to the decoding conditions above, we require that 

Pie + P[>I{X-Yi\U2), (36) 

which is a consequence of setting P[ = I{X;Yi\U2) — 61 as the partition size. 

Combining (18), (21), (24), (26), (28), (30), (32), (34), (35) and (36) using Fourier-Motzkin elimination with 
Ri = Rie + R'l, R2 = R2e + ^2' -^2e = Pie + P3, wc Can obtain the inner bound to the secrecy capacity region 
in Theorem 1 as well as condition (8), which completes the proof. 

B. Proof of Achievability for 3-Receiver BC with 2 Degraded Message Sets (Type 1) 

Here, we outUne the proof of achievability for the Type 1 3-receiver BC with 2 degraded message sets and 
secrecy constraints. The coding scheme largely follows that for the 3 degraded message sets case, but with the 
key difference being the assignment of the message Wi using the auxiliary codewords. Specifically, instead of 
encoding Wi using the auxiliary codeword U2 and W2 using U3 and X as in the 3 degraded message sets case, 
here, Wi is encoded using U2, U3 and X. We can use the same code partitions and sizes of the partitions for 
security as in the 3 degraded message sets case, even for this different coding scheme. 
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Codebook generation: Let us define Ri = Rie + R[, Rie = Pie + ^2e + ^3, R'l = Pi + P2, and 

' P[^I{X;Ys\U2)-di, 

(37) 

Pi ^ I{U2;Y3\Ui) - Si, 
where Si > and is small for n sufficiently large. 

The code generation follows the same way as in Section IV-A, except that we randomly partition the sequences, 

^2(^0, q2), into 2"-^^ equally-sized bins, and \J^{wo,q^), into 2"^^ equally-sized bins, where P2 = P2e + -f2 + ^2 
and P3 = P3 + P3. The U2 codewords undergo a double partition while U3 undergo a single partition. Then, 
for each product bin (p2:P3) contains the joint typical pair (u2(p25P2)P2)) ^sIpsj^'s)) P2 ^ ■ ■ ■ ,2"^^^'}, 
G {1, . . . , 2^2}, pt g ^ 2"-P2*}, Pa G {1, ... , 2''^^}, e {1, . . . , 2"-P3 } with high probabihty 

P2e + -F2 ^ 

< Q3, (38) 

P2e + P2+PZ<Q2 + Qz- I{U2; Uspi). 

As before, for each joint typical pair {u2{p2,P2)i ^siPs)) corresponding to the product bin {p2,p'2iP3)' generate 
2'^^^ sequences of codewords X.{wo,pi,p[,p2,P2,P3), where Pi = Pu + Pi, for pi G {1, . . . , 2^^'^"} and G 
{1, . . . , 2"^i }, uniformly and randomly over the set of conditionally typical X sequences. The 2"^^ codewords 
are partitioned into 2"^^' subcodes with 2"^i codewords within the subcodes. 

Encoding: To send {w^),wi), express wi by (f 1,^2,^3) and send the codeword -x.{wQ,pi,p'i,p2,p'2-,P?>)- 
Decoding: Assume that {wQ,pi,p2,P3) = (1, 1, 1, 1) is sent and p'^, p'^ can be arbitrary. The receivers decode 
the messages as follows: 

1) Receiver 1 uses joint typical decoding of {ui,U2,U3,x, yi} to find the indices {wQ,pi,p2-,P3). 

2) Receiver 2 uses indirect decoding of U2 to find the index tuo- 

3) Receiver 3 uses indirect decoding of U3 to find the index wq. 

At receiver 1, the decoder seeks the message so that 

(ui('a;o),U2fe,P2)>U3(P3),x(iuo,Pi,pi,P2,P2,P3),yi) £ Tr(^c/i[/2[/3XYi)- (39) 

The error events at receiver 1 can be classified into: 

a) El : (wq,pi,p'^,P2,p'2,P3) = (1, ^,Pi, ^,P2-, 1) but Ui, U2, U3, x are not jointly typical with yi. In this case, 
we have Pr{Ei} < e ^ for large n. 

b) E2 : 'u;o 7^ 1> with arbitrary pi,p2 and ps, but Ui, U2, U3 and x are jointly typical with yi. For Pr{E2} < 
e — > with n sufficiently large to be true, we then need 

Ro + Pie + Pi + P2e + P2 + P3< I{X; Yi). (40) 
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c) E3 : Wo = 1, P2,P3 7^ 1, and pi arbitrary, but Ui, U2, U3, x are jointly typical with yi. For PrjEs} < e — > 
with n sufficiently large to be true, we require 

Pie + Pi + P2e + P^ + P3< I{X; Yi\Ui). (41) 

d) E4 : Wo = I, P2 = 1, P3 / 1, and pi arbitrary, but Ui, U2, U3, x are jointly typical with yi. Then, for 
Pi'{E4} < e ^ with n sufficiently large to be true, we need 

Pie + Pi + P3 < I{X;Yi\U2). (42) 

e) : Wo = 1, P2 / 1, P3 = 1, and pi arbitrary, but ui, U2, U3, x are jointly typical with yi. Then, for 
PrjEs} < e — * with n sufficiently large to be true, we need 

Pie + Pi + P2e + P2< H^; Yi\U3). (43) 

f) Eq : Wo = 1, p2 = 1, P3 = 1 and pi / 1, but Ui, U2, U3, x are jointly typical with yi. Then, for 
PrjEe} < e ^ with n sufficiently large to be true, we require 

Pie + Pi<I{X;Yi\U2,U3). (44) 

The error probabiUty at receiver 1 is therefore less than Pr{Ej} < 6e. 

At receivers 2 and 3, assuming that {wq, 52) = {wo, = (1, 1) is sent, we require 

Ro + Q2<I{U2;Y2), 

(45) 

Ro + Q3<I{U3;Y3), 
for the error probabiUties tending to for n sufficiently large. We additionally have 

Pie + Pi> I{X;Yi\U2), (46) 

which is a consequence of setting P{ = I{X; Yi\U2) — Si as the partition size. 

Combining (38) and (40) to (45) and (46) by using Fourier-Motzkin eUmination with Ri = Rie + R'l, Rie = 
Pie + P2e + P3, we can obtain the rate region in Theorem 2 and the conditions (13). 

C. Equivocation Calculation for 3-Receiver BC with 3 Degraded Message Sets 

In this section, we show that the equivocation rate for the 3-receiver BC with 3 degraded message sets satisfies 
the security conditions in (5). That is, we shall derive the bounds for H{Wi IY3), i?(W2|Y3) and W2IY3). 
In the analysis, we shall make use of the following relation very frequently 

H{U, V) = H{U) + H{y\U). (47) 
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For the message Wi, the equivocation can be bounded in two ways, which respectively correspond to whether 
U2 is the codeword sent to Y2 or X is the codeword sent to Yl. For the former case, we have 

H{Wi\Y3)>H{Wi\Y3,\Ji) 

^=^iJ(W^i,Y3|Ui)-F(Y3|Ui) 

ii-(M^i,U2, Y3IU1) -ii'(U2|M/i,Ui,Y3) - H{Ys\Vi) 
> i?(U2|Ui) + [/f(Y3|U2,Ui) - H(Y3\Vi)] - iJ(U2|Wi,Ui, Y3) 
= ii'(U2|Ui)-I(U2;Y3|Ui)-i/(U2|H^i,Ui,Y3), (48) 

where (a) is by (47), and (b) has first two terms by (47). Now, we can bound each term in (48) separately. For 
the first term, given ui, U2 has 2'"^^^'^'^'^^^^^ codewords with equal probabihty. As such, 

H{V2\Vi) = nI{U2;Y2\Ui) - n6[, (49) 

where S[> and is small for n sufficiently large. The second term can be bounded by [3] 

/(U2; Y3IU1) < nI{U2;Y3\Ui) + n6', (50) 

where S' > and is small for n sufficiently large. For the third term, by Fano's inequaUty, we have 

^H{V2\Wi,Ui,Ys) < ^{l + X{w[)logR[)^e'2,n, (51) 

where ^ for n sufficiently large. 

To show that X{w[) < 2k where k ^ for n sufficiently large so that (51) holds, consider decoding at the 
wiretapper and the codebook with rate R'l to be decoded at the wiretapper with error probability X{w[). Let 
Wi = wi and Wq = wq be fixed. We note that the wiretapper decodes U2 first as it will then use this knowledge 
to decode X later. The wiretapper decodes U2 given Wi = wi and Ui = ui, by finding the index w'l, so that 

(ui (wo), U2 {wq ,wi,w[),y3) e [Pu, [7,^3 ) • (52) 

If there is none or more than one possible codeword, an error is declared. Now, define the event 

E^'^K) = {ui(y;o),U2(y;o,^i,H),y3 e {Pu.u.y,)} ■ (53) 
Then, assuming that U2{wq,w\, 1) is sent, 

A(^) < Yt[(y!-^^{1)Y]+Y.^t[y!-^^\i)] < ^ + 2"«i2-"(^(^-^3|c/0-25)^ (54) 

where (5 — >^ as e — >^ for n sufficiently large. Thus, since we have chosen R'^ = I{U2\Yz\U{) — 61 for the 
double-binning partition, we get \{w'i) < 2k for Si > 2S and (51) holds. Substituting (49)-(51) into (48), we 
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have H{Wi\Y3) > nRie — nei, where ei = S[ + 6' + 63 and hence the equivocation rate satisfies the first 
condition in (5 a). 

For message Wi sent using X to Yi, we have 

H{Wi\Y3) > H{Wi,Y3\lJi) - i?(Y3|Ui) 

= i?(VFi,X, Y3IU1) - if(X|VFi,Ui, Y3) - i/(Y3|Ui) 
> i?(X|Ui) + ii-(Y3|Ui, X) - H{Ys\Ui) - H{X\Wi,lJi,Ys) 
>i7(X|Ui,U2,U3) + ii'(Y3|Ui,U2,X)-ii-(Y3|Ui)-iJ(U2,X|T^i,Ui,Y3) 
= //(X|Ui, U2, U3) - /(U2, X; Y3IU1) - H{\J2\Wi, Ui, Y3) - //(X|Vyi, Ui, U2, Y3). (55) 
For the first term in (55), given ui,U2,U3, X has 2'^^^-^'^^\'^^'^'^'^^'> codewords with equal probability. Then, 
i/(X|Ui, U2, U3) = nI{X; Yi\U2, U3, Ui) - n6[ 

= nI{X- Yi\U2) - n5[ or nI{X- Yip^) - n5[. (56) 
The last equalities are due to I{X- Yi\U2, C/3, Ui) = I{X; Yi\Ui) - I{U2, U3;Yi\Ui) and 

/(C/2,C/3;Yi|C/i) =7(C/2;yi|C/i)+7(C/3;yi|C/2,C/i) =/(C/2;Yi|[/i), (57) 
IiU2,U3;Yi\Ui) = IiU3]Yi\Ui) + IiU2]Yi\U3,Ui) = IiU3;Yi\Ui), (58) 
where the above equalities are due to the Markov chain conditions (9). Thus, for this case, we choose 

H(:^\Vi,V2,V3) = nIiX;Yi\U3) - nS[. (59) 
The second term in (55) can be bounded as 

/(U2,X;Y3|Ui) =/(U2;Y3|Ui) + /(X;Y3|U2,Ui) <n/(C/2;Y3|?7i)+n/(X;Y3|C/2) + 2n,5'. (60) 

The third term in (55) may be bounded using Fano's inequahty as in (51). The fourth term can also be bounded 
using Fano's inequahty, by which we have 

^H{X\W,,\Ji,V2,Y3) < ^(l + A(p;)logP{) ^e;,„, (61) 

where e^^ — > for n sufficiently large. To show that X{p'i) < 2k so that (61) holds, assume that wiretapper 13 
knows U2 = U2, Ui = ui and decodes y:{wo,wi,w'i,p3,pi,p'i) by finding the index p[, so that 

{ui{wo),U2{wo,Wi,w[),U3{p3),:X.{wo,Wi,w[,P3,pi,Pi),y3) € T2{Pu^U2UiXY^)- (62) 

If there is none or more than one possible codeword, an error is declared. Define the event 

E^'^Ipi) - {ui(u;o),U2(uio,w^i,^),U3(]93),X(u;o,u;i,w;'i,P3,Pi,p'i);y3 G {Pu^u^u^XY^)} , (63) 
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where wo,wi,w[ are known. Assuming that yi{wo,wi,w[,p3,pi, 1) is sent, we then have 

X{p[) < Pr{(Ef )(1))'} +^Pr {e^ )(1)} < ^ + 2«^i'2-"(^(^;^3|C/.,t/.)-26)^ (64) 

where 5 ^ as e ^ for n sufficiently large. Since we have chosen P{ = I{X; Y-^\U2)~Si, we obtain X{p'i) < 2k 
for 6i > 26. Thus, (61) holds and substituting (59), (60), (51), (61) into (55), we have HiWilY^) > nRi,, - nh, 
where ne\ = 5'i + 25' + e'l „ + ^2 n small for n sufficiently large, so the second condition in (5a) is satisfied. 
For the message W2, the equivocation can be bounded by 

^(H^2|Y3) >i7(W^2|Y3,Ui,U2) 

= lf(W^2, Y3IU1, U2) - //(YalUi, U2) 

= i?(W2, X, YalUi, U2) - //(Xl W2, Ui, U2, Ya) - /^(YalUi, U2) 

> //(X|Ui,U2) + [i/(Y3|Ui,U2,X) - i?(Y3|Ui,U2)] - i?(X|T¥2,Ui,U2,Y3) 

> /f(X|Ui, U2, U3) - I(X; Y3IU1, U2) - i?(X|W2, Ui, U2, Y3). (65) 
For the first term in (65), given ui, U2, U3, X has 2"^('''-'^il^2'^3,!^i) codewords with equal probability. Thus, 

i7(X|Ui,U2,U3) = nI{X-Y^\U2) - n5[, (66) 

as discussed in the obtaining of (56). The second term is bounded by 

7(X; Y3|U2,U3) < nI{X-Y^\U2,U^) + n5', (67) 

where 5' > Q and is small for n sufficiently large. For the third term, by Fano's inequality, we have 

^i7(X|T^2,U2,U3,Y3) < i(l + A(p;)logP{) (68) 

where eg ^ for n sufficiently large. To show that \{p'i) < 2k. so that (68) holds, since the wiretapper knows 
W2, we can assume that wiretapper knows U3 = U3, U2 = U2, Ui = ui and decodes x(wo, wi,w'i,Pi^Pi,p'i) 
by finding the index p'^, such that 

(ui(w;o),U2(u;0,«^l,^),U3(p3),x(wo,tt)l,w'i,P3,Pl,Pi),y3) ^ T'e {Pu^U^U^^XY:,) ■ (69) 

If there is none or more than one possible codeword, an error is declared. Define the event 

^2^''^ip'i) - {^l{m),'^2{wo,Wl,w[),^^2,{pz),^{wQ,Wl,w[,p■i,pl,p^),y■i G ^^'{Pu^u^UiXY^)], (70) 

where i(;o,'u^i,w^'i,P3 are known. Assuming that x(u;o,'u;i,u;'i,P3,pi, 1) is sent, we then have 

A(yi) <Pr{(Ef )(l))'} + ^Pr{E(^)(l)} <A^ + 2"^^'2-"«^;^3|C/.,t/.,t/3)-25)^ (^^^ 

Pi 



23 

where S^Oase^Ofoin sufficiently large. Since we have chosen 

Pi = IiX;Ys\U2)-6i=IiX;Y^\UuU2,U3)-du (72) 

we obtain X{p[) < 2k for Si > 26 and (68) holds. Substituting (66), (67) and (68) into (65), we have H{W2\Y3) > 
ni?2e — i^^2, where 62 = S'i + S' + £3^, and the equivocation rate satisfies (5b). 
For the combined message {Wi, W2), we have 

H{Wi,W2\Y3) > H{Wi,W2\Y3,\Ji) 

= H{Wi,W2,Ys\Vi) - H{Ys\Vi) 

= H{Wi,W2,X,Y3\\Ji) - H{X\Wi,W2,\Ji,Ys) - H{Y3\\Ji) 
> Ji-(X|Ui) + ff(Y3|Ui,X) - iI(Y3|Ui) - ii-(U2,X|M^i, l^2,Ui, Y3) 
>H{X\Vi) + [H{Y3\Vi,V2,X)-H(Y3\Vi)]-H(U2\Wi,W2,Vi,Y-i) 
-ii'(X|T^i,M^2,Ui,U2,Y3). (73) 
For the first term, we have 

H{X\\Ji) = nI{X; Yi\Ui) - nS[. (74) 

The second term can be bounded by 

/(U2,X;Y3|Ui) < nI{U2;Y3\Ui)+nI{X;Ys\U2) + 2n6'. (75) 

The fourth and fifth terms are, respectively, 

-H{V2\Wi,W2,\Ji,Ys) < ii^(U2|M^i,Ui, Y3) < e^„, (76) 
n n ' 

^HiX\Wi,W2,Vi,V2,Y3) < ^iJ(X|W^i,Ui,U2,Y3) < ei,„. (77) 
Substituting the above into (73), we get 

H{Wi, W2\Y3) > nRu + ni?2e - nei,2, (78) 
where 61^2 = S[ + 25' + e^^ + eg^^, thus satisfying (5c). As a result, we see that the security conditions in (5) 
are satisfied and we have shown that the rate-equivocation tuple {Ro, Ri,Rie, R2, R2e) is achievable. 

V. Outer Bounds for the 3-Receiver BC with Degraded Message Sets 
In the derivation of the outer bounds, we note that, for the original Markov chain conditions 

Ui^U2^ {Us, X) ^ (Fi, I2, ^3), (V9a) 
Ui^Us^ {U2, X) ^ {Yi,Y2, Ys), (79b) 
Ui ^ {U2, U3)^X^ {Yi,Y2, Ys), (79c) 
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which arise from the code generation for the 3-receiver BC, there exists the set of conditions 



(80a) 



Ui^Us^ {U2,U2,X) ^ (^1,^2, is), 



(80b) 



C/i ^ {U2, U2, Us)^X-^ (Fi, Y2,Ys), 



(80c) 



which come about by inserting auxiUary random variable U2 between U\ and U2 in the code generation, so that 
Ui ^ U2 ^ U2 is satisfied. The code generation and decoding conditions are equivalent for the following: 

1) For the 3-receiver BC with 3 degraded message sets, let U2 represent information about Wo, and set 
U2 = Ui for equivalent code generation and decoding conditions under (79) and (80); 

2) For the 3-receiver BC with 3 degraded message sets, let U2 represent information about Wi, and set 
U2 = U2 for equivalent code generation and decoding conditions under both (79) and (80); 

3) For the 3-receiver BC with 2 degraded message sets (Type 1), let U2 represent information about Wi, and 
set U2 = Ui for equivalent code generation and decoding conditions under (79) and (80). 

We will show that case (1) is true in the Appendix of this paper, while cases (2) and (3) are shown to be true 
in [11, Appendix HI]. 

So, to obtain the outer bound to the rate equivocation region for the 3-receiver BC with 3 degraded message 
sets, we first find the outer bound TZ'q for the 3-receiver BC using conditions (80). Then we set U2 = Ui (as in 
case (1)) to obtain the outer bound to the rate equivocation region for the 3-receiver BC with 3 degraded message 
sets TZo with original conditions (79). 

For the 3-receiver BC with 2 degraded message sets (Type 1), we use the same procedure. 

A. Proof for the 3-receiver BC with 3 degraded message sets 

In this section we show the proof for the outer bound in Theorem 2. We use a (2"^° , 2"^^ , 2"^^ , n)-code with 
error probability Pi"^ with the code construction so that we have the Markov chain condition (Wo,VFi,VF2) 
^ X (Yi, Y2, Y3). Then, the probabihty distiibution on Wo x Wi x W2 x Af" x x y^' x y§ is given by 



n 



p{wo)p{wi)p{w2)p{yi\wo,wi,w2) '[Ip{yii,y2i,y3i\xi). 



(81) 



i=l 
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(82) 



By Fano's inequality, we have 

H{Wo\Yk) < hRqP^''^ + 1 = n7fc, k = 1, 2, 3, 
H{Wo, Wi\Yi) < n{Ro + + 1 ^ 7174, 

H{Wo, Wi\Y2) < n{Ro + + 1 ^ 7175, 

H{Wo, W2\Yi) < n{Ro + i?2)Pi"^ + 1 = n76, 
H{Wo, Wi, W2IY1) < n(i?o + Ri + R2)Pt^ + 1 = n77, 
i7(iyo, M^2|Y2) < n(i2o + i?2)^'i"^ + 1 = nj8, 

(n) 

where ^jk ^ if Pe ^ \/k. Now we want to define the auxiliary random variables Ui^i, U2,i, U2,i, U^,i, 
satisfying the conditions 

Ui,i lJ2,i U2,i {U3,i, Xi) ^ {Y,,i, Y2,i, Ys,i), (83a) 

Ui,i ^ U3,i ^ {U2,i, U2,i, Xi) ^ {Yi,i, Y2,i, Y3,i), (83b) 

Ul,i ^ ([/2,i, C/2,^, U3,i) ^Xi^ (n,,, y2,^, l3,i), (83c) 

for all i. When we have derived the outer bounds for the rates for conditions (83), we can then set U2,i = C/i,j 
to obtain the rates for the original conditions 



Ui,i U2,i ^ {Us,i,Xi) ^ {Y^,i,Y2,i,Ys,i), 
Ui,i ^ U3,i ^ {U2,i,Xi) ^ {Yi,i,Y2,i,Y3,i), 
Ui,i ^ {U2,i, U3,i) ^Xi^ (Yi,,,F2,i, 



(84a) 
(84b) 
(84c) 



Here, however, we will define the auxiliary random variables C/i,, = (W^o, Y^"^), U2,i = (C/i,j, Y^+^), U2,i = Wi, 
U3,i = (C/i,j, Yg"*"^) which satisfy the conditions 

Ui,i ^ {U2,i, U2,i) ^ {U3,i,Xi) ^ (Fi ^2,., ^3,^), (85a) 
Ui,i ^ [/3,i ^ iU2,i, U2,i, Xi) ^ (Yi,,, Y2,i, Y3,i), (85b) 
C/i,i ^ {U2,i, U2,i, ^ ^ (Yi,,, Y2,i, Ys^i), (85c) 

for all i, which are weaker than and included in conditions (83). By setting f/2,i = in (85), we still obtain 
the original conditions (84). Thus we use (85) in our subsequent derivation for the outer bound. 
We first prove three relations which are a consequence of (85). 

Relation 1: I{Yi+^-Yk,i\WoXi^) = I{Yi+\Yi+'-Yk,i\Wo,Y\-') = I{Yi+^;Yk,i\Wo,Y{-^),k = 1,2,3. 
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Proof: For any Yfe j, k = 1, 2, 3, we have 

= I{%+^;Yk,i\Wo,Y\-^) + I{%+^-,Yk,^Wo,Y\-\%+^) 

^=^J(Y^+^n,,|Wo,Yi-'), (86) 

where (a) is due to /(Y^+^ ^,^1 Wq, Y^-\ Y^+^) = I{U2,i]Yks\U?,,i) = by (85a) and (b) is due to the fact 
that I{Yf^-Yk,i\Wo,Y{~\%^^) = liU^X^YkAi) = by (85b). ■ 
Relation 2: I{Yl+^;Yk,i\Wo,Y\-^) = I{WuYf^\Yk,i\Wo,Y\-^) = I{Wr,Yk,i\W^,Y\-^),k = 1,2,3. 
Proof: For any Yjt^j, k = 1, 2, 3, we have 

/(Y|+i;n,i|Wo,Yi-i) = I{Wi,Yf^-YkAWo,Y{-^) - I{Wr,YkAWo,Y\-\Yl+^) 

I{W^,Yl+\Yk,^Wo,Y\-^) 



= 7(W^i;n,,|W-o, Yi-') + /(Y|+i;n,,|W-o, Wi, Yi-') 

I{Wi;Yk,i\Wo,Y\-^), (87) 



where (a) is due to I{Wi;Yk^i\WQ,YX-^ ,Y'^^) = I{U2,i;Yk4U^,^ = by (85a) and (b) is due to the fact that 
/(Y|+i; Yfe,,|W^o, W^,Y{-^) = I{U^,i- Yk,i\U2,i, C/i,^) = by (85b). ■ 
Relation 3: IiYi+';Yk,i\Wo, Wi,Y{-') = J(Y^+^ Yk,i\Wo, Wi,Y{-'), k = l,2, 3. 
Proof: For any Yk^i, A: = 1, 2, 3, we have 

IiYi+';Yk,i\Wo,Wi,Y\-') = I{Y'^+\Y'^+';Y^^^^ 

I{Yi-^\Yi+^-,Yk,i\Wo,Wi,Y\-^) 
= /(Y|+i;n,,|W^o,W^i,Y^-i) + I(Y|+^yfc,,|W^o,H^i,Yi-\Y^+i) 

/(Y|+i; Yk,i\Wo, Wi,Y\-^), (88) 

where (a) is due to I{Yl+^■,Yk,^\Wo,Wl,Y\-\Yl+') = /(C/s,^; n,*|C/2,i, t/2,i) = by (85b); and (b) is by 
I{Yl+';Yk,i\Wo,W,,Yl-\Yi+') = I{U2,i;Yk,i\U2,M,i) = H{Yk,i\U2,i,Us,i) - HiYk,i\U2,i,U2,M,i) = by 
(85a). ■ 
We begin by proving the outer bounds to the equivocation rates. For Rig, we have two possible choices 
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corresponding to whether X is sent to Yi or U2 is sent to Y2. For the first case, we have 
nRie < H{Wi\Y3) + nil (by secrecy condition) 
= H{Wi\Ys, Wo) + I{Wi; W0IY3) + nei 
= H{Wi\Wo) - I{Wr,Y3\Wo) + I{Wi; W0IY3) + nh 
= I{Wi;Yi\Wo) + H{Wi\Wo,Yi) - J(Wi; Y3IW0) + /(Wi; W0IY3) + nei 
= I{Wr,Yi\Wo) - /(Wi; Y3IW0) + H{Wo\Y3) - H{Wo\Wi,Ys) + H{Wi\Wo,Yi) + nh 

< I{Wi;Yi\Wo) - I{Wi;Y3\Wo)+H{Wo\Y3) + H{Wi\Wo,Yi) + nei 

< /(Wi; YilWo) -/(Wi;Y3|Wo) +n(ei +73 + 74), (89) 
where (a) is by Fano's inequality. Expanding the first two terms of (a) by the chain rule, we obtain 

n 

I{Wr,Yi\Wo) =J2liWr,Yi,i\Wo,Y\-^), (90a) 

i=l 
n 

/(Wi; Y3IW0) = ^I(Wi;y3,dW^o, Y^+')- (90b) 

i=l 

Now we have 

n 

nRie < E [/(^i;n,i|Wo, Yi-i) -7(Wi;F3,i|W^o,Y*+i)] + n(ei + 73 + 74). (91) 

i=l 

The terms under the summation can be bounded by 

IiWi;Yi4Wo,Y{-^) - I{Wi;Ys,i\Wo,Yi+^) 
= I{Wi,Yf+';Yi4Wo,Y{-')-IiWi,Yl-'-,Ys4Wo,Yl^^^ 
+ I{Y\-';Ys,i\Wo,Wi,Yi+^) 

I{Wl,Yl+';Yl,,\Wo,Y\-')-I{WuY\-';Ys,^\Wo,Y^^^^ 
+ 7(Y^+^yi,i|Wo,Wi,Yi-i) 

= /(Wi,Y|+i;yM|Wo,Yr') - J(Wi, Yi-i;y3,i|W^o, Y^+') 
= /(X,,Wi,Y^+i;yi,i|Wo,Yi-^) -/(Xi,Wi,Yi-i;y3,i|M/^o,Y^+') 
- [/(X,;yi,,|Wo,Wi,Yr\Y^+') -/(X,;y3,^|W-o,W^i,Yr\Y^+')] 

(6) 

< I(X,,Wi,Y^+^yi,i|Wo,Yri) -I(X,,Wi,Yri;y3,i|W^o,Y^+i) 



(c) 



7(X,; Fi,, I Wo, Yr\ Y|+i) - /(X,; F3,i I W^o, Yr\ Y^+') + /(Y^+^ 
/(Yi-^l3,^|t^o,Yfi) 
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^i/(X,;yi,i|W^o,Yr\Y^+i)-7(X,;y3,dW^o,Yr\Y|+i) + /(Y|+i^ 

- I{Yl+';Y,,i\Wo,Yl-') 
= 7(X,;yi,,|Wo,Yr\Y|+i)-/(X,;y3,i|VFo,Yi-\Y|+i) 

= I{X,;Y^^,\Wo,Yl-\Yi+') - [/(X,,Y^+i;y3,*|H^0,Yi-i) -I(Y^+i;y3,*l^^0,Yi-^)] 

I{Xi;Y,,i\Wo,Y\-\Yi+') - [/(X,; y3,,|T^o, Yi"!) - /(Y^+i; y3,i|T^o, Yi"!)] 
= IiXi-Yi,i\U3,i) - [IiXi-Y3,i\Ui,i) - I{U2;Ys,i\Ui,i)] IiXf,Yi,i\Us,i) - IiXi-Ys,i\Ui,i), (92) 
where (a) has last term by [1, Lemma 7] so that 

/(Y^+i; yi,,|T^o, W^i, Yi-i) = 7(Yi-^ y3,,|W-o, W^i, Y|+i); 
i=l 1=1 

(b) is due to [I{Xf,Yi,i\Wo,Wi,Yi-\Yi+^) - I{Xf,Y3,i\Wo,Wi,Y\~\Yi+^)] > by the fact that Yi is a 
more capable chamiel than 13 along with the fact that it may be verified using a functional dependency graph [17] 
that {Wo,Wi,Y{-^,Yi+^) ^ Xi ^ (^i,j,^3,j) forms a Markov chain, so the more capable channel condition 
is satisfied [15]; (c) is because I{Wi]Yi^i\Wo,Y\-\Yi+^ , Xi) = by 

I{Wi;Yi,i\Wo,Y\~\^t\Xi) = iJ(yi,i|W^o,Yi-\Y|+SXi) -iI(yi,i|W^o,W^i,Yi-\Y^+\Xi) 
= H{Y,,i\Wo,Y\-\Yi+\Xi) - H{Y,,i\Wo,Y\-\Yi-^\Xi) = 0, (93) 

where the second equahty is obtained using the relation Wi — > ^ on the second term on the right-hand-side, 
and similarly /(W^i; y3,,|Wo, Y^"\ Y^+^ Xj) = 0; (d) has last term by [1, Lemma 7] so that 

n n 

^/(Y^+i;yi,|M/o,Yr^)=^/(Yi-i;y3,|iyo,Yfi); 
i=l i=l 

(e) has the first term in the square brackets by the fact that /(Y|+^; y3,i | Wo, Y\-^,Xi) = since given Xi, Y3 
is independent of Y^^i as may be seen using a functional dependency graph, and the second term in the square 
brackets /(Y^+^y3,j|Wo, Y^-^) = I(Y|+^;y3,i|Wo, Y}"^) by Relation 1; and (f) is by substituting U2,i = Ui,i. 
Then, we have 

n 

nRie < E iH^i' - I{Xi- Y^,i\Ui,i)] + n{h + 73 + 74). (94) 

1=1 

Next consider the rate for Wi sent to receiver Y2. We have, following (89), 

nRu < I{Wr,Y2\Wo)-I{Wv,Y3\Wo) + H{Wo\Y3) + H{Wi\Wo,Y2) + n€i 

< /(Wi; Y2IW0) - I{Wi;Ys\Wo) + n(ei + 73 + 75), (95) 
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where (a) is by Fano's inequality. For the first two terms in (95), we have 

n 

I{Wv,Y2\Wq) - I{Wr,Y^\Wo) = [liWi-,Y24Wo,Yi+^) - I{Wi-,Y3,i\Wo,Y. 



3 ; 



i=l 



i=l 



+I{Y{-';Ys,i\Wo,Wi,Yi, 



i+i- 



(a) 



n 

^ [l{WuY\-';Y2,i\Wo,Yi+^)-I{Wi,Y{-';Ys,i\Wo,^^^^^ 



i=l 



+I{Yi+';Y,,i\Wo,Wi,Y\ 



(96) 



(b) 



J2 [/(T^i,Yi-i;F2,|W^o,Y^+') -/(^i,Yr^l3,|W^o,Y^+'; 



i=l 



Y,[liYl';Y2,\Wo,Y^2'') + HWi-,Y2,i\Wo,Y\-\Y^,+^^ 



i=l 



+I{Xi;Y^,i\Wo,Wi,Y\-\Yi+'' 



<Y,[liYl+'-Y,,i\Wo,Y{-') + IiWv,Y2,i\Wo,Y{-^ 



i=l 



-I{Xi- Y^,i\Wo, Y\~\Yi+^) + I{Xf, Ys,i\Wo, Wi,Y\-\Yl 



(97) 



^ [l{Yi+^;Y,,i\Wo,Y{-') + I{Wv,Y2,i\Wo,Y{-\Yi+') - I{Yi+^;Y,,i\Wo,Y{-') 



-I{Xf,Ys,i\Wo,Y\-^) + I{Yl-'';Ys,i\Wo,Y\-') + I{Xf,Y^^^^^ 



H+l. 



H+l. 



<Y^[l{Wv,Y2,\Wo,Yl-\Y',+') + I{Yl+'-,Y24Wo,Yl-'^ 

i=l 

n n 
E [^(U2,i; Y2,i\U2,i, Ui^i) + IiU2,i; Y3,i\Ui,^) - I{U2,i; Y^,^Ui,i)\ = E [^(^^2,.; >2,.|C/l,i) - I{U2,^; 1^3,i|C/l,i)] 



j=l 



(98) 



where (a) has the last two terms by [1, Lemma 7] which gives 

n n 

E/(Yi-^y2,^|Wo,H^l,Y^+^) = E^(Yr^^Ml^o,^l,Y^^), 
i=l i=l 

n n 

E/(Yi-^y3,i|^^o,M^i,Y^+') = E^(Y3+';^M|W^o,^i,Yi-i); 
1=1 i=l 

(b) is because the last two terms in (96) above are I(Y*+^; Fi,,] Wq, Wi,Y\-^) = /(Y*+^; yi,j|Wo, Wi,Y\-^) = 
I{U3,i;Yi,i\U2,i,Ui,i) = by Relation 3 and (85b) and similarly IiYi+'-Yi4Wo,Wi,Yl-') = 0; (c) is by [1, 
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Lemma 7] which gives 

n n 

^/(Yi-^i2,,|w^o, Y^+') = Y^i{n-'';yi,i\wo,Y{-'y, 

i=l i=l 
(d) is by [1, Lemma 7] from which 

n n 

i=l i=l 
and (e) is by I(Y'+^;Y,4Wo, Y^^) = I{Yi+^;Y,,i\Wo, Y\-^) and IiYi+^;Ys,i\Wo,Y{-') = /(Y^+i; Fs.ilW^o, Y 
by Relation 1. Consequently we have 

n 

nRie < J2 [IiU2,i;Y2,i\Ui,i) - I{U2,i; Y3,i\Ui,i)] + n(ei + 73 + 75)- (99) 

i=l 

For the equivocation rate i?2e» we consider 11^2 sent to receiver Yi using codeword X. Following the same 
procedure to obtain (89), we get 

nR2e < H{W2\Y3)+ne2 

< I{W2;Yi\Wo) - I{W2;Y:i\Wo) + HiWo\Y3) + H{W2\Wo,Y,) 

< /(W^2;Yi|H^o) -/(H^2;Y3|H^o) + n(e2 + 73 + 76), (100) 

by Fano's inequality. Expanding the first two terms of the inequality above by the chain rule and following the 
same procedure as for i?ie in (90a), (90b) to (91), we obtain 

n 

nR2e < E [^(W^2;yM|W^o,Yi-') - A^2;y3,i|W^o,Y|+i)] +n(e2 + 73 + 76). (101) 

i=l 

The terms under the summation can be bounded as 

I{W2;Yi,i\Wo,Y\-^) - I{W2;Y3,i\Wo,Yi+^) 

= /(Y|+\ W2; Y,,i\Wo, Yi-') - /(W-2, Yi-^ Y3,,|T^o, Yi+^) - I(Y^+^ YmIW^q, W2, Y\-^) 
+ I{Yl-';Y2,i\Wo,W2,Yi+') 
I{Yi+\W2;Y,,,\Wo,Yi-^) - IiW2,Y{-';Ys,i\Wo,^^^^^ 

+ IiYi+';Yu\Wo,W2,Y'^^) 

= /(Y^+\ 1^2; li,^|H^o, Yi-i) - /(H^2, Yi-^ y3,^| W^o, Y^+') 
= I{Yi+^;Y,,i\Wo,Y\-') + I{W2;Yi,i\Wo,Yi-\Yi+') - /(Yr';y3,«|W^o, Y^+') 
-/(W^2;l3,i|M^o,Yi-\Y^+') 
I{Yi+\Yi,i\Wo,Y\-') + I{W2;Yi,i\Wo,Y\-\Yi+') - I{Yi+\Yi,i\Wo,Y\-') 

- I{W2;Y34Wo,Y{-\Yl+'') 
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= /(Ws; Y-mIW^o, Yi-1, - IiW2;Ys,i\Wo,Y\-\Yi+^) (102a) 

= I{Xi, W2; Y,,i\Wo, Y{-\Yl+') - I{Xi, W2; Ys,i\Wo, Y\-\YI+') 

- [7(X,;yi,,|Wo, W-2,Yr\Y|+i) -/(X,;y3,dW^o, W-2,Yi-\Y|+i)] 

< /(x,,^2;i^M|M^o,Yi-\Y^+i) -/(x,,Ty2;n,i|M^o,Yi-\Y^+i) 

= I{Xi,W2,Yi+';Yi,i\Wo,Yi-^)-IiXi,W2,Y^^^^ 

- [/(Y^+i;yi,|VFo,Yr^) -/(Y^+^l3,|H^o,Yr^)] 

< I{Xf,Yi,i\Wo,Y\-') - I{Xf,Y3,i\Wo,Y\-') - [IiWi;Yi,i\Wo,Y\-') - IiWi;Y3,i\Wo,Y\-')] 

= I{Xf,Yi,i\U2,i) - I{Xf, Y3,i\U2,i) (102b) 
where (a) is by [1, Lemma 7] so that 

n n 

J2 /(Y^+i; yi,,|T^o, W2,Yl-') = E I(Yl-';Y,,\Wo, W2,Yl+'), 
i=l 1=1 

(b) is also by [1, Lemma 7] giving 

n 11 

^/(Yf^Fi,|l^o,Yi-i) = ^/(Yr^y3.|^o,Yf'), 
i=l i=l 

(c) is because [/(X^; ^1,^1 Wq, W2, Y'f \ Y^+^) -/(X^; Fa,* I Wo, W2, Y'f \ Y|+^)] > since Yi is a more capable 
channel than 13 and (Wq, W^2, Y^""^, Yg"*"^) ^ — > (yi,j,l3,j) forms a Markov chain so satisfying the more 
capable channel condition, and (d) is due to firstly, 

I{W2,Yi-^^;Yi,i\Wo,Y{-\Xi) = HiYi,i\Wo,Yr\Xi) - H{Yi,i\Wo,W2,Yi+\Y\-\Xi) 
= HiYi4Wo,Y\-\Xi) - H(Yi,i\Wo,Y\-\Xi) = 0, (103) 

which is true since, given Xi, Yg"*"^ is independent of Y^^i as can be verified using a functional dependency graph, 
and by W2 ^ X^ ^ Yi^i, secondly, I{W2,Yi~^^;Y3^i\Wo,Y\~^,Xi) = since given Xj, Y^+^ is independent 
of Ys,i and W2 ^ Xi ^ ^3,^; and thirdly, I{Yi+^;Yk,i\Wo,Y\-^) = I{Wi;Yk,i\Wo,Y\-^) for A; = 1,3 from 
Relation 2. Then, we shall have 

n 

nR2e < E i^i^i' Yi,i\U2,i) - I{Xi; Ys,i\U2,i)] + n{e2 + 73 + Te)- (104) 

i=l 

For the rates {Ru + R2e), consider the combined message {Wi, W2) sent to receiver Yi using codeword X. 
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It can be shown that 

n{Ru + R2e) < H{Wi, 1 Y3) + ei,2 

< I{Wx,W2\Y^\Wo) - I{Wi,W2]Y^\Wo)+H{WQ\Y^) + H{Wi,W2\Wo,Yi) + ei,2 
(6) 

< 7(W^i, W2; Yil^o) - I{W^. W2; Y3IW0) + "(61,2 + 73 + 77) 

(c) " 

< ^[/(iyi,T¥2;li,i|^o,Yr\Y^+i)-/(M^i,M^2;l3,»|H^o,Yi-\Y^+')] + n(ei,2 + 73 + 77) (105) 

i=l 

where (a) results in following the steps in (89) using (Wi, W2) instead of W\, (b) is by Fano's inequahty, and 
(c) results in following the steps to obtain (102a) using (VFi, W2) instead of W2. The terms under the summation 
can be bounded as 

W2-, Y^,i\Wo, Y\-\Y\+^) - /(W^i, W2-, Yz,i\Wo, Y\-\Y\+^) 
= I{Xi, Wi, W2; Y^,i\Wo, Y{-\Yi+') - I{Xi, Wi,W2;Y3,i\Wo, Y{-\ Y|+1) 

- [I{Xi; Yi^Wo, Wi, W2, Y\-\Yf+') - /(X^; ^3,^11^0, Wi, W2, Y{-\Yf+')] 

< I{Xi, Wi,W2;Yi,i\Wo, Y{-\ Y|+1) - 7(X,, W,,W2; Ya.d^^o, Y\-\Yi+') 
= I{Xi, Wi, W2,Yi+^;Y^AWo,Y\-') - I{Xi, W^i, 1^2, Y^+^ Ys,i\Wo,Y{~') 

- [7(Yr^yi,,|W^o,Yr) -/(Y|+i;F3,^|W^o,Yi-^)] 

I{Xi;Y^,i\Wo,Y\-') - I{Xf,Ys,i\Wo,Y{-') - [I(Y^+^ yu|H^o, Yl"!) - /(Y^+^ ^ll^o, Yl"')] 
= I{Xf,Yi,i\Ui,i) - I{Xi;Y3,i\U,,i) - [IiU2,i;Y,,i\U,,i) - I{U2,i;Ys,i\Ui,i)] 

I{Xi;Yi,i\Ui,i) - I{Xf,Y3,i\Ui,i), (106) 

where (a) is due to Yi being a more capable channel than Yi which gives [I{Xi; Yi^i\Wo, Wi, W2,Y\^^ ,Y"^^^) — 
I{Xi;Ys4Wo, Wi,W2.Yl-\Yi+^)] > for {Wq, Wi,W2,Y{-\Yi+^) ^ X^ ^ (Fi,,, Ya.i) as may be verified 
using a functional dependency graph; (b) is due to, first, that 

I{WuW2,Y'+^-Yi^i\Wo,Y\-\Xi) = H{Yi^i\Wo,Y\-\Xi)-H{^^^^^ 

= H{Y^,i\Wo,Y\-\Xi) - H{Y^^i\Wo,Y\-\Xi) = (107) 

since in the second term in the second equality is obtained using the relation {Wi, W2) Xi ^ Yi,j and the fact 
that given Xj, Yg^^ is independent of Yi^j, secondly, we can obtain I{Wi, W2; Yi,j|Wo, Y^~\ Yg+^Xj) = in 
a similar way, and thirdly we have, by Relation 1, I{Yi+^-Yk,i\Wo,Y\-^) = I{Yi+^-Yk^i\Wo,Y\-^), k = l,3; 



(c) is by substituting U2,i = ?7i,i. Then, we have 



n{Ru + R2e) < E i^i^i' - I{Xu Yz,i\Ui,i), ] + n(ei,2 + 73 + Tt)- 

i=l 

We now prove the rates for Rq, Rq + Ri, Rq + R2 and Rq + Ri + R2. For rate Rq, we have 



nRo = H{Wo) = I {Wo; Yi) + H{Wo\Yi) 

< /(Wo; Yi) + nji by Fano's inequahty 

n 

= J2l{Wo;Yi,i\Yi-') + nji 



1=1 



<J2HWo,Y{-';Y,,i)+nji 
i=l 

n 

= E/([/i,i;yi,i)+n7i. 



1=1 



We also have 



+ ^73 



nRo = H{Wo) = /(Wo; Y3) + //(W0IY3) 

< /(Wo; Y3) + 7173 by Fano's inequality 

= X^/(Wo;y3,i|Yi+i) + n73 

i=l 
n 

= E[/(Wo,Yr;F3,,|Yi+i)-/(Yr;y3,i|Wo,Y|+i)" 

j=l 

< [/(Wo,Yi-\Y|+i;i3,0 -/(Y|+l;yl,^|Wo,Y^')] +nj3 

i=l 
n 

= J2 [HU3,i; Ys,i) - I{U^,i; yi,i|?7i,i)] + n73 

i=l 

Where (a) is by [l,Lemma 7] from which E?=i /(Y^-i; y3,dWo, Y^+') = E«=i ^(Y^+'; Wq, Y 
For the rates {Ro + Ri), we consider the following cases when the messages are sent: 

1) Case 1: Wi sent to Yi, Wq sent to Yi or F3; 

2) Case 2: Wi sent to I2, Wq sent to Yi or F3; 

3) Case 3: Wq, Wi both sent to Y^. 
For Case 1, we have 

n{Ro + Ri) = //(Wo, Wi) = //(Wo) + //(Wi|Wo) 

= //(Wo) + /(Wi; Yi|Wo) + //(WilWo, Yi) 

(a) " 

< //(Wo) + E/(Wi;yi,i|Wo,Yr')+74 
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where (a) is by expanding using the chain rule and using Fano's inequahty. Then, on combining with H{Wo) 
using (109), we can get 

n 

n{Ro + Ri)<Yl [HWo, Y{-^;Yi,i) + I{Wr,Yi,i\Wo, Y{-^)\ + ^(71 + 74) 

n 



= ^ I{Wi; yi,i) + n(7i + 74) = E ^(^2,^; Yi^i) + ^(71 + 74) (113) 
1=1 1=1 

and, combining with H{Wo) using (111), we obtain 

n 

n{R^ + Ri) < E [liWo,Y{-\Yl+';Y3,i) - I{Yi+'-Yi,i\Wo,Yl-') + I{Wr,Y,,i\Wo,Yl-')] +71(73 + 74) 

i=l 

n 

< E [IiUs,i- Ys^i) + I{U2,i; Yi,i\Ui,i)] + 71(73 + 74). (114) 

i=l 

For Case 2, we similarly have 

n{Ro + = H{Wo) + I(P^i; Yal^^o) + i^(T^i|T^o, Y2) 

n 

< iJ(W^o) + E IiWi;Y2,i\Wo, Y|+i) + n75 

i=l 
n 

= H{Wo) + ^[l{Wi,Y{-^;Y2,i\Wo,n''')-Hn~'-,Y2AWo,Wi^^^^^ 

i=l 

H{Wo) + f2[l{Y{-';Y2,i\Wo,Yi+') + IiWi-Y2,i^^^^ 



i=l 



+ ^75 



+ n75 



= il(H^o) + E [^(^2,i; n,i|[/i,i) + /(C/2,i; y2,i|C/2,i, Ui,i)\ + 7Z75 = ii'(M^o) + E ^(^2,^; :^2,i|t/i,i) + n75 
1=1 i=i 

(115) 

where (a) has the last term in the sum by [1, Lemma 7] giving 

n n 

EW';>^2,i|T^o,H^i,Y^+') = E^(Y2+';^M|W^o,W^i,Yi-i); 

i=i 1=1 

(b) is by I{Y'^+^;Yi,,\Wo, Wi,Y\-^) = I{Yi+^;Yi,i\Wo, W^Y^^) = I{U3,i; Yi,i\U2,i, Ui,i) = from Relation 
3 and (85b) and first term under the sum by [1, Lemma 7] from which 

n n 

J2l{Yr';Y2,i\Wo,Yi+') = E W;n,^iw^o, Yi-^). 

i=l 1=1 

Combining with H{Wq) using (109) and (111), we obtain 

n 

n(i?o + i?i) < E [HUi,i;Yi,i) + I{U2,i;Y2,i\Ui,i)]+n{^i+-f5), (116) 

i=l 
n 

n{Ro + Ri) < E [IiU3,i;Y3,i) + I{U2,i;Y2,i\Ui,i)]+ni-f3 + -f5). (117) 
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For Case 3 we have 



n{Ro + Ri) = H{Wo,Wi) = IiWo,Wi-Y2) + H{Wo,Wi\Y2) 

(a) " 
i=l 



n 

i=l 

n 

[j(W-o,W^i,Yr^F2,,|Y^+i) -7(Y^+^yi,,|Wo,I^i,Yr') 



i=l 

(6) 



i=l 
n 



+ n75 

+ ^75 



< $^/(C/2,i,C/2,i;l2,i) + n75 = J2liU2,i;Y2,i)+nj5- (118) 

i=l 1=1 

where (a) is by Fano's inequality, and (b) has second term in the sum by [1, Lemma 7]. 

For rates {Rq + R2) consider message W2 sent to receiver Yi and Wq sent to either Yi or Y3. To begin, we 
have 

n(i?o + R2) = H{Wo) + H{W2\Wo) = H{Wo) + /(W^2; Yi|Wo) + F(W^2; Yi|Wo) 
< H{Wo) + J2 HW2; Yi,i\Wo, Y{-^) + n76 < H{Wo) + I{W2; Wi,Yi,i\Wo, Y{-^) + n^e 

1=1 i=l 

H{Wo) + I{W2; Yi,i\Wo, Wi,Y{-^) + 7175 < il(W^o) + E ^(^^i Yi,i\Wo, Wi, + 7176 

i=l i=l 



= i?(W^o) + E[^(^^'^i;^Ml^o,Yri)-/(W^i;yi,,|M^o,Yi-i)] +7175 (119) 

i=l 

y i^(W'o) + E [^(^i'^i;^Ml^o,Yri) -I(W^i,Y^+^yi,i|tyo,Yi-i)] +n76 
y^ if(T^o) + E [^(^-^Ml^o,Yi-^) -/(W^i,Y^+i;yi,,|M/^o,Yi-i) 



=1 

n 



+ 77,76 



= H{Wo) + yi,i|C/2,i, C/3,i) + n76 (120) 

i=l 

where (a) is by Fano's inequality; (b) is by the independence of Wi and W2; (c) is by Wi — > ^ Yi j; (d) is 
by Relation 2; and (e) is because 

I{Wv,Y,,i\Wo, Y{-\Xi) = H{Y,,i\Wo, Y\-\Xi) - H{Y,,i\Wo, W,,Yl-\Xi) 

= H{Yi,i\Wo,Y\-\Xi) - H{Yi,i\Wo,Y\-\Xi) = (121) 

with the second term in the second equality being due to Wi — > — > Yi j. Combine the results with H(Wo) in 
two ways. Firstly, we do this by combining with (110) using (120) to get 

n 

n(i?o + R2)<Y1 [^(^1-^; ^1,^) + ^(^^5 yi,ip2,i, Us,i)] + 77(71 + 76). (122) 
1=1 
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Next combine with (111) using (119) to get 

n 

n{Ra + R2) < J2 [l{Wo,Yi-\Yl+^-,Y3,i) - Ii%+^-Yi,i\Wo,Yl-^) + I{Xi,Wi-^^^^^^ 

i=l 

-I{Wv,Yi,i\Wo,Y\-')\ + n(73 + Te) 

n 

= E 1^(^3,1-, Y3,i) - IiU3,i; Yi,i\Ui,i) + I{Xf, Yi,i|C/i,i) - I{U2,i; Yi,i\Ui,i)] + 71(73 + 75) 

i=l 
(«) ^ 

< E [^(^3,i; Y3,i) + I{Xi; Yi,i\Ui,i) - I{U2,i, U3,i; Yi,i\Ui,i)] + 71(73 + 75) 
1=1 

n 

= Y^[I{U3,i;Y3,i) + I{Xi;Yi,i\U2,i,U3,i)]+n{j3+je), (123) 

i=l 

where (a) is by 

Af^2,i;y"M|t^M) + i"(i73,i;yi,,|C/i,i) = I{U2,i,Us,i;Y,,i\Ui,i) - IiU3,f,Yi,i\Ui,i,^^^^^ 

> I{U2,i,Us,f,Yi,i\Ui,^) - I{U3,f,Yi,i\U,,i,U2,i) + I{U3,^;Yi,,\U,,i,U2,i) = I{U2,i,U3,f,Yi,i\U,,i) (124) 

with the inequahty obtained using (85a). 

Lastly, for the rates (i?o + Ri + R2), consider the following combinations of messages sent to the receivers: 

1) Case 1: Wi,W2 sent to Yi, Wo sent to Yi or Y3, 

2) Case 2: Wi sent to Y2, W2 sent to Yi, Wo sent to Yi or ^3, 

3) Case 3: Wq, VFi sent to Y2, W2 sent to Yi. 
For Case 1, we have 

n{Ro + i?i + R2) = H{Wo) + H{Wi,W2\Wo) = H{Wo) + HWi, ^^2; Yi|Wo) + H{Wi,W2\Wo,Yi) 

n 



i=l 



(a) 

< H{Wo) + Y,[l{Wv,Yi,i\Wo,Y\-^) + I{Xf,Yi,i\Wo,Wi,Y{-^] 

i=l 



+ r^77 



= H{Wo) + E H^f, Yi,i\Wo, Y{-^) + 7177, (125) 

i=l 

where (a) is by Wi ^ Xi ^ Yi j. Then combining with (109), we have 



It, It 

n{Ro + Ri + R2) < E [l{Wo,Y\-^;Yi,i) + I{Xf,Yi,i\Wo,Y{~^)] +n(7i+77) = E^(^i;^M) + ^(7i + 77)- 
i=i 1=1 

(126) 
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Combining (125) with (111), we have 

n 



1=1 

n 

= J2 [IiU3,i; Y3,i) + I{Xi- Y,,i\U3,i)] + n(73 + 77)- 
1=1 

For Case 2 we have 

n(i?o + Ri + R2) = H{Wo) + H{Wi\Wo) + H{W2\Wo, Wi) 

= H{WQ) + I{Wr,Y2\WQ) + H{W2\WQ,Y2) + I{W2\Y^\WQ,Wi) + H{W2\Wo,Wi,Y^ 



(127) 



+ n(75 + 78) 



< H{Wo) + Y.[I{Wl■Y2,^\Wo,%+^) + I{W2■,Y^,,\Wo,Wl,Y\-^) 

i=l 

(a) " 

1=1 

+I{Xf, Y,,i\Wo, Wi,Y\-^)] + n(75 + 73) 

n 

= H{Wo) + Y.[l{Yl-';Y2,i\Wo,Yl+') + I{Wv,Y2,i\Wo,Y\-\Y^^^^^ 

i=l 

+I{Xi,Wv,Y,,i\Wo,Y\-^) - I{Wv,Y,,i\Wo,Y\-^)] +71(75 + 78) 

H{Wo)+J2[n'^t'-^yhi\Wo,Yt^)+IiWi-Y2,^^^^^ 
1=1 

+/(X,, Wi;Fi,,|W^o,Yr') -7(W^i,Y^+^yi,,|Wo,Yr') +7(Y^+i;yi,,|W^ 
i7(iyo) + E [^(Y2+';>l,.l^o, Yi-1) + I(T^i;y2,^|W^o, Yi-1, Y^^) 

i=l 

+/(Xi;ri,,|W^o,Yl-i) -/(VFi,Y|+i;Fi,,|VFo,Yi-')] + n(75 + 78) (128) 

n 

= H{Wo) + E ^(^^2,^; Yi,,|C/i,,) + I{U2,i; Y2,i\U2,i, Ui,i) + /(X,; yi,i|C/2,i, [/g.^l + n(75 + js) 



i=l 



= H{Wo) + E lHU2,i; Y2,i\Ui,i) + I{Xf, Yi,i\U2,i, U3,i)] + n(75 + 78) 
where (a) is by W2 ^ — > Yi (b) is by [1, Lemma 7] which gives 

n n 

E/(Yi-i;i2,^|w^o,Y^+') = E^(Y2+';n,i|w^o,Yi-i), 



(129) 



i=l 



E/(Yi-^y2,dW^o,t^i,Y^+') = E^(Y2+';^Ml^o,W^i,Yi-i); 



i=l 



i=l 



(c) is by I{Yi+^;Yi,i\Wo,WuY{-^) = I{Yf+^;Y^,i\Wo,Wi,Y\-^) = I{U3,f,Yi,i\U2,i,Ui,i) = from Relation 
3 and (85b), and also we have I{Wi;Yi^i\Wo, Y\-^,Xi) = from Wi ^ Xi ^ Yi^i and I{Yi+^;Yi^i\Wo, Wi,Y\-^] 
from (85b). 
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Now combine (109) with (129) to get 

n 

n{Ro + Ri+R2)<Y1 yi,i) + I{U2,i; Y2,i\Ui,i) + I{Xi- Yi,i\U2,i, f/a,^)] + n(7i + 75 + 78)- (130) 

i=l 

Next combine (111) with (128), so that 

n{Ro + Ri + R2) 

n 

< J2 [l{Wo,Y{-\Yi+';Ys,i) - /(Y|+i;Fi,,|T^o, Yi-') +/(Y^+^yi,,|W^O, Yi-i) 

i=l 

+I{Wi-Y2,i\Wo, Yi-\Yi+') + I{Xi- Y^,i\Wo, Yl'^) - 7(W^i, Y|+i; Fi,^ |W^o, Y^')] + n(73 + 75 + 78) 

, , n 

^ [l{Wo, Yl\Yf+^;Ys,i) + I{Wr,Y2,i\Wo, Y{-\Y',+^) 

i=l 

+I{Xi;Y,,,\Wo,Y\-') - IiWu%+';Y,^i\Wo,Y\-')] +n(73 + 75 + 78) 

n 

= E [^(^3,i; l3,i) + I(.U2,i; Y2,i\Ui,i) + I{Xi- Y^,i\U2,u U^,^] + 71(73 + 75 + 78), 



(131) 



where (a) is due to I{Y^^^-Yi^i\Wo,Y\-^) = I{Y'^^-Yi^i\Wo,Y\-^) by Relation 1. 
For Case 3, we have 

n{Ro + Ri + R2) = H{Wq, Wi) + H{W2\Wq, Wi) 

= I{Wo, WuY2) + H{Wo, W,\Y2) + I{W2; Yi\Wo, Wi) + H{W2\Wo, W^Y,) 

n 

< J2 [/(Wo, Wi;y2,i|Y|+i) + J(W^2;y"M|W^o, Wi,Yi-')] +n(75 + 77) 

i=l 

< E [ Wi;Y2,i\Yi+^) + I{Xi; Y^^Wq, Wi,Y{-^)] + 71(75 + 77) 



i=l 



(6) 



< J2 [HU2,i; Y2,i) + I{Xf, Y,,i\U2,i, U3,i)] + 71(75 + 77), 



(132) 



(133) 



i=l 



where (a) is by W2 — > ^ li and (b) is by following the steps in (118) for the first term in the sum of 
(132) and the steps from (119)-(120) for the second term in the sum of (132). 

Finally, introduce random variable G, which is independent of all other random variables and taking on values 
z, for z = 1, 2, . . . , n, with probability l/7i. Define Uk = {G, Uk,G), X = Xq, Y^ = Yk^o^ k = 1,2, 3. Then, we 
can obtain the rate region in Theorem 2 using (94), (99), (104), (108), (110), (112), (113), (114), (116), (117), 
(118), (122), (123), (126), (127), (130), (131) and (133). 



B. Proof of the outer bound for the 3-receiver BC with 2 degraded message sets (Type 1) 

In this section we show the proof for the outer bound of Corollary 2. The same code construction as in Section 
V-A, and preserve the definitions for the auxiliary random variables. 
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We begin with the equivocation rate i?ie. Following the same procedure to obtain (89) - (91), we have 

n 

nRu < E [liWi;Yi,i\Wo,Y{-^) - I{Wi-,Ys,i\Wo,Yl+^)] +n(e; +73 + 74) 

i=l 

n 

1=1 

-I{Yi+';Yi4Wo, Wi,Y{-') + I{Yl-';Y3,i\Wo, Wi,Yl+')] + n{e[ + 73 + 74) 
J2 [/(Wi,Y|+i;yi,,|W^o,Yr') -/(Wl,Y^';y3,^|W-o,Y^+') 

i=l 

-I{Yl+';Yi,i\Wo, W,,Y{-') + /(Y^+i; Fi,,|H^o, Wi, Y{-')] + n(e; + 73 + 74) 

n 

= ^[/(T^i,Y^+i;yi,,|T^o,Yr')-/(M^i,Yi-i;y3,^|W^o,Y^+')] +n(e;+73 + 74) 



1=1 



n 

J2 [/(^i,M^i,Yf i;yi,,|iyo,Yr') -/(^i,W^i,Yr^l3,*|H^o,Y^+'] 



1=1 



(b) 
< 



- [l{Xf, Y.^Wo, W,,Y\-\Yi+^) - I{Xf, Y3,i\Wo, W,,Y\-\Yi+'))] + n{e[ + 73 + 74) 

n 

J2 [H^i, Wi, Yi+'-Yi,i\Wo, Y{-') - liXi, Wi,Y{-';Ys,i\Wo, Y^+^)] + n{e[ + 73 + 74) 

i=l 

. , n 

^ [l(X,;yi,,|W^o,Yi-i) -/(Yi-i;y3,,|W^o,Y^+i) - I{Xi-Y^,,\W^,Y\-\Yl+^)] +n(e; +73 + 74) 

i=l 

n 

= ^[/(X,;yi,i|l^o,Yri)-/(Yri;y3,i|W^o,Y^+')-/(^i,Y^+i;y3,i|^o,Yri) 

i=l 

+I{Y\+^-Y^^i\Wo,Y\-')\ + n(e; + 73 + 74) 

f2 [/(X,;yi,,|Wo,Yr') -/(Y|+i;yi,,|Wo,Yr') - J(X,;y3,i|Wo,Yi-') 

i=l 

+I{Yi+';Ys,i\Wo, Y\-')] + n(ei + 73 + 74) 

, , n 

^ [l{X,;Y,,,\Wo,Y\-') - I{Yl+';Y,,,\Wo,Y\-') - IiXf,Y3,,\Wo,Y\-') 

i=l 

+I{Yi+^; Ys,i\Wo, Y{-')] + nie[ + 73 + 74) 

n 

= J2 [H^u yi,iPi,i) - I{U2,i\ - I{X,- Y^^U^^i) + I{U2,i; >3,i|?^i,i)] + n(ei + 73 + 74) 

i=l 
(f) " 

^ [/(Xi; yi,«|C/i,^) - /(X,; Y3,i\Ui,i)] + n(ei + 73 + 74) (134) 

i=l 

where (a) is due to [1, Lemma 7] which gives 

n n 

5^/(Yi-i;y3,i|W^o,H^i,Y^+') = E^(Y3+';^Ml^o,W^i,Yi-i); 



i=l 



1=1 
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(b) is due to the fact that Yi is a more capable channel than Y3 so that I{Xi-Yi^i\Wo,Wi,Yl-\Yl+') - 
I{Xi;Y3,,\Wo,Wi,Y\-^,Yi+^) > and is true as (VFq, VFi, Y^-\ Y^+^) ^ X,, ^ (^i,i,^3,i) forms a Markov 



chain so that the more capable channel condition is satisfied; (c) is because /(VFi, Y3 ; j| , Xj) = 

since given Xi, Wi and Yg"*"^ are both independent of Yi j from a functional dependency graph, and we also 
have I{Wi;Y3^i\WQ,Y]^^ ^Y"^^^ ,Xi) = since we have Wi — >■ — > Yi/, (d) has second term in the sum by 
[1, Lemma 7] by which we have 

n n 

^/(Yi-i;Y3,|W^0,Y^+')=EW;>^Ml^0,Yi-i), 
i=l i=l 

and third term by /(Y^+^ Y3,i|Wo, Y\-^,Xi) = since given Xi, Y"^^^ is independent of ^3,1; (e) is by Relation 
1; and (f) is by substituting C/2,i = U\^i. 

For rates Rq we already have, from (110), (112) the rates for Wq sent to Yi and Y3. For Wq sent to Y2, we 
have 



nRo < E ^(^0; Y2,i\Yi+') + n72 

n 

= E [liWo,Y{-';Y2,i\Yl+') - /(Yj-^ Y2,,|Wo, Y 



2 ) 



+ ^72 



(a) " 



< E [l(iyo,H^i,Yi-\Y^+^Y2,i) -/(W^i;li,i|H^o,Yi-'y 



n 



+ n72 



E [/(W^o,H^i,Yri;Y2,0 +/(Y^+';Y2,,|Tyo,H^i,Yi-i) -/(W^i;Yi,i|iyo,Yri] 



i=l 



+ n72 



E [l{Wo,Wi,Y{-';Y2,i) - I{Wv,Yi,i\Wo,Y{-') 



i=l 

n 



+ n72 



i=l 



(135) 



where (a) is due to 



^/(Yi-i; Y2,i|l^o, Y^+i) = ^/(Y^+i; Yi,,|H^o, Yi-i) 

n n 

Y,Iin-''-,Yi,i\Wo,Y{-') = Y^I{W,-Y,,i\Wo,Y{-') 



1=1 



(136) 

j=i 1=1 
with the first equality due to [1, Lemma 7], the second and third equaUties by Relations 1 and 2, respectively; 

(b) is due to /(Y^+^; Y2,i|VFo, l^i, Y}"^) = /(Y^+^; Y2,i|VFo, Wi,Y{-^) = by Relation 3 and (85b). 
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So we have 

n 

nRo < ^IiUi,i; ^1,0 + n^i, (137) 

i=l 

n 

nRo < [I{U2,i; Y2,i) - I{U2,i; Yi,i\Ui,i)] + nj2, (138) 
1=1 

n 

nRo < [I{U3,i- Y3,i) - I{U3,i; Yi,i|?7i,i)] + n^s- (139) 

i=l 

For rates Ro + Ri, consider Wq sent to Yi, ^2, ^ and Wi to Yi only. We have 

n 

n{Ro + Ri) < H{Wo) + ^/(Tyi;yi,i|VFo, Yi"') + ^74 

1=1 

(a) " 

< //(M/o) + E^(^i;^Ml^o,Yri) + n74, (140) 
1=1 

where (a) is by Wi ^ — > Yi j. Then combining (140) with (137), (138), (139), respectively, we can get 

n 

n{Ro + Ri)<Y ^(^i! ^i.i) + ^(71 + 74) (141) 

i=l 

n 

n{Ro + Ri)<Yl [IiU2,i; Y2,i) + I{Xf, Yi,i\U2,i)] + n{j2 + 74) (142) 

i=l 

n 

n{Ro + Ri)<Yl Y3,i) + I{Xi; Yi^ip^^i)] + 11(73 + 74). (143) 

1=1 

Now introduce the random variables G, X, Yj., k = 1,2, 3, and Uk, A; = 1, 2 as at the end of Section V-A, 
and using (134), (137), (138), (139), (141), (142) and (143), we can obtain the rate region in Corollary 2. So 
we have shown that the 3 degraded message set outer bound can reduce to the 2 degraded message set (Type 1) 
outer bound, as we have used the same condition (Yi more capable than Y3), auxiUary random variable definition 
and code construction so that (81) is satisfied. 

C. Proof for the 3-receiver BC with 2 degraded message sets (Type 2) with both Yi and Y2 less noisy than Y3 
In this section we show the converse proof for the bound in Corollary 3. We now use a (2"^", 2"^^, n)- 
code with error probability Pi"'' and code construction so that we have the Markov chain condition (VFqjM^i) 
^ X ^ (Yi, Y2, Y3). Then, the probability distribution on Wq x Wi x X"" x x x y§ is given by 

n 

p{wo)p{wi)p{y.\wo,wi)Y[p{yii,y2i,y3i\xi). (144) 

i=l 

We first note that from the definition of more capable and less noisy channels [15], when Yi is less noisy than 
Y2 or Y3, then it also follows that Yi is more capable than Y2 or Y3. 
We now also define the new auxihary random variable Ui = (Wo,Yl~^) satisfying the condition 

Ui^Xi^ (Yi,i, Y2,i, Y3,i), Vi. (145) 
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To proceed with the proof, we begin with the equivocation rates. We will consider 2 cases: the first, where 
Wi is sent to Yi, the second where Wi is sent to Y2. For Wi sent to Yi, we have, following (89) 

nRie < H{Wi\Ys) + ne'i (by secrecy condition) 

< /(Wi; Yi I Wo) - I{Wi;Y3\Wo) + n{e\ + 73 + 74)- 

Then the first two terms of (146) can be bounded as 

n 

I{Wi;Yi\Wo) - IiWi;Y-i\Wo) = ^ [l{Wi;Yi,i\Wo,Y\+') - /(W^i; ^a.^lW^o, Y^-^; 



n 

= Y.[liWi,Yl-';Yi,i\Wo,Y\+') - I{WuY\+';Y^,i\Wo,Yl^^ 

i=l 



) 



+I{Yl+';Y3,i\Wo,W,,Yl-') 



J2 [l{W,,Yi-';Yi,i\Wo,Y\+')-I{Wi,Y\+';Ys^^^^^^ 

i=l 

+I{Y{+';Ys,i\Wo,W,,Yl') 

n 

= ^[/(W^i,Yr^YM|W^o,Yi+i)- W,Yi+i;F3,|W^o,Yr^)" 

i=l 

n 

= ^ [/(Xi,l^i,Yr^Yi,i|l^o,Yi+i) -/(X,,T^i,Yi+i;y3,i|W^o,Yr') 

i=l 

- (/(X,;yi,,|T^o,W^i,Yl+\Yri) -/(X,;y3,,|W^o,Wi,Yl+\Yr'))' 

(b) " P -, 
< J2 [/(^i,W^i,Yr^YM|W^o,Yl+i) -/(Xi,T^i,Yl+i;y3,i|H^o,Yr') 

i=l 

. , n 

[l{Yl-^-Y^,^W^,Y\+^)+I{Xr,Y^,^W^,Y\+\Y\^^^ 



i=l 



y [l{Y\+^-Y^,i\W^,Y\-^) + I{Xi,Y\+^-Y^,^W^,^^^^^ 

i=l 



-I{Xf,Ys,i\Wo,Yl 



(146) 



Y [l{Xf,Y,,i\Wo,Yi-^)-I{Xf,Y3,i\Wo,Yi-') - (/(Yl+i; Yi,,|W^o, Yr') - /(Yi+l;y3,^|W^o, Yr')) 



< J2 [l{Xi;Y^,i\Wo,Yi-^) - I{Xf,Ys,i\Wo,Yi-^)] (147) 

1=1 

where (a) is by [1, Lemma 7] from which 

n n 

^ /(Y^-1; yi,,|T^o, H^i, Yi+1) = E ^(^1+'; ^3,^| W^o, t^i, Y^-1); 
i=l i=l 

(b) is by I{Xi;Yi^i\Wo,Wi,Y\+^,Y'f^) - /(X^; ^3,^ |VFo, VFi, Y*+\ Y*"^) > as Fi is more capable than ^3 



which is a consequence of the assumption that Yi is less noisy than ^3, with {Wo,Wi,Y\~^^ ,Yl 
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(^1,1) Y3,i) fulfilling the more capable channel condition; (c) is because we have / Yl^jlWo, Y^"*"^, Yg ^,Xi) = 
since Wi is independent of Yi^i given Xi and I{Wi,Y{+^;Y3,,\Wo,Yi-^ , Xi) = since Wi and Y\+^ are 
both independent of Y^ i given X-i, both of which can be verified using a functional dependency graph; (d) has 
first term by [1, Lemma 7] from which 

n n 

j2i(yr';Yi,i\wo,Y{+') = j2H'y\''';Y3,i\wo,Yi-'y, 

i=l i=l 

(e) is by / ( Y^"^ ^ ; ,« I Wq , Yl~ ^,Xi) = since Y^"*" ^ is independent of Yi ,i given Xi from a functional dependency 
graph; and (f) is due to I{Y{+^;Yi^i\Wo, Y^f^) - I{Y\+^;Y3^i\Wo, Y'f^) > from the fact that Yi is less noisy 
than Y3. Thus we have 



nRie < E iHXi-, Yi,i\Ui) - I{Xi- Y^^ipi)] + n(e'i + 73 + 74). 



(148) 



1=1 



For rate Rie arising from Wi sent to Y2, we follow the same procedure as in (146) to (148), except that 
all terms involving Y\ are replaced with the corresponding terms involving Y2, and carry out the expansion 
I{Wi;Y2\Wo) = X;r=i-f(^i;^2,i|Wo,Y^+^) instead, and the condition that Y2 is less noisy than Fa is used. 
Then we can get 



nRie < E [^(^^; Y2,i\Ui) - I{Xi- Y3,i\Ui)] + n{e\ + 72 + 74). 

i=l 

The rate Rq may be easily found as 

n 

nRo = H{Wo) < J2HWo;Y3,i\Yi-^) + njs 
1=1 

n n 

< E HWo, yg.i) + n73 = E ^i^i; ^3,^) + ^73- 

i=l i=l 

For rates Rq + Ri, first consider Wi sent to receiver Yi. We have 
n{Ro + Ri) = H{Wo) + H{Wi\Wo) < H(Wo) + J(W^i; Yi|Wo) + 7174 
= H{Wo) + E IiWv,Yi,i\Wo, Yi+i) + n74 < H{Wo) + E ^i^u Yi,i\Wo, Y{+^) + 7174 

i=l 

n 

< //(M^o) + E ^(^i' Yr >l,i|W^o, Yi+1) + n74 



(149) 



(150) 



i=l 



i=l 

n 



^(W^o) + E[^(Yr';>^Ml^^o,Yi+i) + /(X,;yM|l^o,Yi+i,Yr^: 



+ ^74 



i=l 



n 

HiWo) + Y^[l{Y\+'-,Y3,,\Wo,Yf,-') + I{Xi,Y\+'-^^^^^ 



i=l 
n 



< i/(T^o) + E^(^i;^Ml^o,Y^-i) +n74 



+ ^74 

(151) 
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where (a) is by Wi ^ — > Yi (b) is by [1, Lemma 7] from which 

n n 

^/(Yr^ri,,|H^o,Yi+i) = EW;^3,^iH^o,Yr^); 

i=l i=l 

and (c) is because /(Y{+^; ^1,^ | Wq, Y^"^) - /(Yi+^ Ya^il Wq, Y|"^) > as Yi is less noisy than Y3 and 
/(Y^^^; Yi j[Wo, Yg^^, Xj) = as Y^^^ is independent of Yi j given Xi from a functional dependency graph. 

Next, for Wi sent to Y2, again follow the same procedure as to obtain (151), except that all terms involving 
Yi are replaced with the corresponding terms involving Y2, and carry out the expansion /(l^i;Y2|Wo) = 
J27=i ^(^1; Y2,i|Wo, Y^"*"^), and the condition that Y2 is less noisy than Y3 is used. As such, we have 



n(i2o + Ri) < HiWo) + J2 li^u Y2,i\Wo, Y^^) + 7175. (152) 

i=l 

For rates {Ro + Ri), considering {Wq, Wi) sent to receiver 1, we combine (150) with (151) to obtain 

n 

n(i?o + Ri)<Yl [^(^0, Y^-i; Y3,i) + I{Xi; Yi,i\Wo, Yl')] + 71(73 + 74) 



1=1 



n 

J2 [l{Wo,Yi-';Y,,i) - [l{Wo,Yi-';Yi,i) - IiWo,Yi-';Y3,i)) + /(X^; Yi,,|W^o, 



Yr^^ 



1=1 



+ "-(73 + 74) 

(a) " 

< ^ I{Xi; Yi^i) + 7z(73 + 74) (153) 

i=l 

where (a) is by the condition /(Wq, Yg"^; Yi j) - /(Wq, Yg"^; Y3 j) > from Yi being less noisy than Y3. Now 
considering {Wq, Wi) sent to receiver 2, combine (150) with (152) in the same way to obtain 

n 

n{RQ + Ri)<J2 ^(^i; Y2,i) + n(73 + 75) (154) 

i=l 

where now we have I{Wo, Yg"^; l2,i) — I(Wo, Yg"^; Y3 j) > from Y2 being less noisy than I3. 

Finally, introduce the random variables G, X, Y^, A; = 1, 2, 3, as at the end of Section V-A, and the random 
variable U = {G, Uq). Using (150), (148), (149), (153) and (154), we obtain the rate region in Corollary 3. 
Thus we have shown that the outer bound for this 3-receiver, 2 degraded message set (Type 2) channel is a 
specialization of the more general 3-receiver, 3 degraded message set channel. We note that the outer bound to 
the rate equivocation region in Corollary 3 also coincides with a special case of the achievable bound of Chia 
and El Gamal [9] stated in Theorem 1 of [9], for the same message destinations and secrecy conditions. 



VI. Conclusion 

Bounds to the rate-equivocation region for the general 3-receiver BC with degraded message sets, in which 
receiver 3 is a wiretapper receiving the common message, are presented. This model is a more general model 
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than the 2-receiver BCs with confidential messages with an external wiretapper, and 3-receiver degraded BCs 
with confidential messages. We obtain, with secrecy, new inner and outer bounds to the rate-equivocation region 
for the 3-receiver BC with 3 degraded message sets. We also obtain, without secrecy, new outer bounds to the 
rate region for the general 3-receiver BC with 3 degraded message sets. Lastly, we obtain new inner and outer 
bounds for rate-equivocation region for the 3-receiver BC with 2 degraded message sets (Type 1). 

In the proof of achievabiUty for the iimer bound, we used Wyner's code partitioning combined with double- 
bimung for secrecy. We have shown that the proposed coding scheme can provide security for the 3-receiver BC 
with 3 degraded message sets or 2 degraded message sets (Type 1), although the 2 degraded message set case 
(Type 1) will suffer a loss in the secrecy rate. The proof for the outer bound is shown for the 3-receiver BC 
with 3 degraded message sets and 2 degraded message sets (Type 1) under the condition that receiver 1 is more 
capable than receiver 3 the wiretapper; and for the 3-receiver BC with 2 degraded message sets (Type 2) for 
receivers 1 and 2 less noisy than the wiretapper The outer bound for the 3 degraded message set case is shown 
to specialize to the 2 degraded message set (Type 1). Under the condition that both receivers 1 and 2 are less 
noisy than the wiretapper, the inner and outer bounds for the 3 degraded message case coincide and speciahze to 
the rate-equivocation region of the 3-receiver BC with 2 degraded message sets (Type 2), and to a special case 
of a 3-receiver BC with 2 degraded message sets (Type 2) which uses a different coding scheme. 

Appendix 

Here, we show that we can insert an auxiUary random variable U2, representing information about Wq, between 
Ui and U2, for the 3-receiver BC with 3 degraded message sets. We show that the conditions for correct code 
generation and low probability of error for decoding are equivalent to those without insertion of U2 by setting 
U2 = Ui. Thus, by their equivalence, we shall subsequently use the code generation process with the insertion 
of IJ2 to facilitate the derivation of the outer bound. 

We first note that such an insertion of U2 gives rise to the Markov chains 

Ui^U2^U2^ {Us, X) ^ {Yi,Y2, Ys), (155a) 
U^^Us^ {U2,U2,X) ^ {Y^,Y2,Ys), (155b) 
Ui ^ {U2,U2,U3) ^X^ {Yi,Y2,Y3). (155c) 

Codebook generation is done as follows: first, generate 2"^" sequences Ui(wo)- Then, for each \Ji{wo), 
generate 2"'52 sequences \J2{wo,Q2) and partition them into 2"^^ equal-sized bins, and also 2"-^^ sequences 
^3{wo,q3). For each 1)2(^0)^2), generate 2"^^^ sequences U2(iU0)P2, §2) and partition them into 2"^^ bins. 
Also partition the U3{wo,qs) into 2"^=* equally-sized bins. 
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Fig. 5. Coding for 3-receiver BC with degraded message sets and confidential messages: insertion of auxiliary random variable U2- 



Each product bin {wi,w[,p3) contains the joint typical pair (112(^05^2, wi,w'i,w\),\J3{wo,ps,p\)) with high 
probability under the conditions [16] 

P2 < Q2, 

Rle + R'l < Q2, 

P3 < Qs, (156) 

P2 + P3<Q2 + Q3-I{U2;U3\Ui), 

^ P2 + Rle + R[ + P3<Q2 + Q2 + Q3- l{U2; Us\Ui). 
For the joint typical pair {\J2{wo,p2,'Wi,Wi),\J3{wo,ps)) corresponding to the product bin {wi,w'i,p3), gen- 
erate 2"^i sequences of codewords 'K{'Wo,p2,wi,w[,ps,pi,p[). The decoding follows from what described in 
Section IV-A. Assume that {wo,p2,wi,p3,pi) = (1, 1, 1, 1, 1) is sent. For receiver Yi, joint typical decoding of 
{ui, U2, U2, U3, yi} is carried out. We list the error events and the conditions that ensure low error probability 
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when decoding, while noting that the decoding of p2 and wi is independent: 

1) Pr{Ei : {wo /!)}<€ when 

R0 + P2 + Rie + R'l + Pie + Pi + P3< liX; Yi). (157) 

2) Pr{E2 : (wo = \,V2 + 1)} < e when 

P2 + Rxe + + Pxe + P[ + P3< I{X; Yi\Ui). (158) 

3) Pr{E3 : {wq = l,p2 ^l,wi^ 1)} < e when 

P2 + Rle + R[ + Pie + P[ + Pz< I{X- Yi|[/i). (159) 

4) Pr{E4 : {wq = l,p2 ^l,wi^ l,p3 = !)}<€ when 

P2 + Rle + R'l + Pie + Pi < I{X; Yi\Us, Ui) = I{X; ^ IC/3). (160) 

5) Pr{E5 : {wq = l,p2 ^ l,wi = l,p3 ^ 1)} < e when 

P2 + Pie + Pi + P3< I{X; Yi\U2, Ui) = I{X; Yi\U2). (161) 

6) Pr{E6 : {wo = l,P2 ^l,wi = 1,P3 = l,pi / 1)} < e when 

P2 + Pie + Pi < I{X; Yi\U2, Us, Ui) = I{X; Yi\U2, U3). (162) 

7) Pr{E7 : {wq = l,p2 = l,wi ^ 1)} < e when 

Rle + R[ + Pie + Pi + P3< I{X; Yi\U2, Ui) = I{X; Yi\U2). (163) 

8) Pr{E8 : {wq = 1,P2 = 7^ 1,P3 = 1)} < e when 

Rle + R[ + Pie + Pi< I{X; Yi\Us, U2, Ui) = I{X; Y^ps, U2). (164) 

9) Pr{E9 : {wq = l,p2 = l,wi = l,p3 7^ 1)} < e when 

Pie + Pi + P3< I{X; Yi\U2, U2) = I{X; Yi\U2). (165) 

10) Pr{EiO : {wq = l,p2 = l,wi = l,p3 = l,pi 7^ 1)} < e when 

Pie + Pi< I{X; Yi\U2, U2, U3, Ui) = I{X; Yi\U2, Us). (166) 

Receiver Y2 finds {wo,q2) by indirectly decoding U2, and wi by decoding U2 conditioned on {U2,Ui). As a 
result, we have the conditions 

Ro + Q2 + Q2<I{U2;Y2), (167) 
Q2 < I{U2;Y2\U2,Ui) = I{U2;Y2\U2). (168) 
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Receiver 13 finds wq by indirectly decoding Us, which has low probability of error under the condition 

Rq + Q3<I{U3;Y3). (169) 

Compare the above conditions with the conditions for the 3-receiver BC with 3 degraded message sets without 
insertion of U2 found in (18), (21), (24), (26), (28), (30), (32), (34) and (35). By setting U2 = Ui, the conditions 
(156), (157)-(169) are maximized. Furthermore, by setting P2 = Q2 = 0, the conditions (156), (157)-(169) are 
equivalent to those in (18)-(35). Thus, we may insert U2 representing information about Wq between Ui and U2 
giving the Markov chain conditions (155), and the conditions on decoding and code generation thus obtained are 
equivalent to the original conditions with U2 = U\. As such, we can derive the outer bound in 2 steps. In the 
first step, we insert U2 and use Markov chain conditions (155) to obtain an outer bound TZ'q which is equivalent 
to the one with original conditions (9) by setting U2 = Ui. Then, set U2 = Ui in TZ'q to obtain TZq. 
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